-- Logs begin at Wed 2022-07-27 17:22:31 UTC, end at Wed 2022-07-27 19:16:25 UTC. -- Jul 27 18:03:29.601282 dv-cinder-799871-43-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 27 18:03:29.614463 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 27 18:03:29 2022] *** Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: nodename: dv-cinder-799871-43-iscsi Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: machine: x86_64 Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: clock source: unix Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: pcre jit disabled Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: detected number of CPU cores: 4 Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: current working directory: / Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: detected binary path: /usr/bin/uwsgi-core Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: your processes number limit is 47680 Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: your memory page size is 4096 bytes Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: detected max file descriptor number: 2048 Jul 27 18:03:29.616646 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: lock engine: pthread robust mutexes Jul 27 18:03:29.617351 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: thunder lock: enabled Jul 27 18:03:29.617351 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 27 18:03:29.617351 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 27 18:03:29.657338 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: Python main interpreter initialized at 0x5642dd8de9c0 Jul 27 18:03:29.657338 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: python threads support enabled Jul 27 18:03:29.657338 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: your server socket listen backlog is limited to 100 connections Jul 27 18:03:29.657338 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: your mercy for graceful operations on workers is 90 seconds Jul 27 18:03:29.657691 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: mapped 403077 bytes (393 KB) for 2 cores Jul 27 18:03:29.657800 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: *** Operational MODE: preforking *** Jul 27 18:03:29.658311 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: *** uWSGI is running in multiple interpreter mode *** Jul 27 18:03:29.658311 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: spawned uWSGI master process (pid: 80539) Jul 27 18:03:29.658509 dv-cinder-799871-43-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 27 18:03:29.659620 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: spawned uWSGI worker 1 (pid: 80552, cores: 1) Jul 27 18:03:29.659620 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: spawned uWSGI worker 2 (pid: 80553, cores: 1) Jul 27 18:03:29.659620 dv-cinder-799871-43-iscsi devstack@keystone.service[80539]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 27 18:03:35.196698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:03:35.196698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: from cryptography.utils import int_from_bytes Jul 27 18:03:35.197437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:03:35.197437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: from cryptography.utils import int_from_bytes Jul 27 18:03:35.197896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:03:35.197896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: from cryptography.utils import int_from_bytes Jul 27 18:03:35.198040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 27 18:03:35.198040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: from cryptography.utils import int_from_bytes Jul 27 18:03:35.254829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 18:03:35.254995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 18:03:35.255195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] command line args: [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 18:03:35.255301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 27 18:03:35.255466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 18:03:35.255553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 27 18:03:35.255653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ================================================================================ {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 18:03:35.255739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] command line args: [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 27 18:03:35.256471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] admin_token = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.256610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 27 18:03:35.256699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ================================================================================ {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 27 18:03:35.256778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] config_dir = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.256897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] admin_token = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.256983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.257086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] config_source = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.257235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] config_dir = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.257322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] debug = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.257396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.257477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.257873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] config_source = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.257873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] debug = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] list_limit = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.258942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] list_limit = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] log_config_append = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] log_config_append = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] log_dir = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] log_dir = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] log_file = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] log_file = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.259972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.260964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.261936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.262970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.263142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.263412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.263498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.263625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] publish_errors = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.263817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.263894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.67/identity {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] publish_errors = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.264924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] standard_threads = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] standard_threads = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] use_journal = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.265927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] use_json = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] use_stderr = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] use_journal = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] use_syslog = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] use_json = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] use_stderr = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] use_syslog = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.266777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.266921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 27 18:03:35.267082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267423 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.267994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.268957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.269984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.270108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.272942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.273959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274818 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.274960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.275929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276439 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.276921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.277905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.278952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.279951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.280893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.281999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.282079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.282237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.282317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.282469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.282547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.282699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.282786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.283227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.283317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.283479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.283571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.283724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.283804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.283950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.284994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285476 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.285975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286834 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.286921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.287597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.287685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.287837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.287924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.288897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.289878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290036 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.290922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.291973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] auth.external = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.292995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.293120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.293120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] auth.password = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.293365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.293492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] auth.token = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.293644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.293838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.293977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] auth.external = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.294106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.294236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.294363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.294500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.294629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.294756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.294885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.295050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] auth.password = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.295205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.295346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] auth.token = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.295474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.295602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.295744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] credential.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.295872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.296936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] credential.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.297975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.298104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.298258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.298396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.298532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.298532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.298782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.298910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.299039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.299174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.299375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.299515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.299644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.299771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.299898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.300947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.301994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.302122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.302250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.302388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.302517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.302686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.302813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.302937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.303072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.303210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.303905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.304594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.305430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.305557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.305684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.305684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.305936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.306947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.307093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.307225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.307349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.307479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.307615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.307752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.307877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.308891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.309995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.310977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.311870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.312844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313568 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.313979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.314925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.315962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.316907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.317892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.318921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.319991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320454 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.320956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.321100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.321180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.321345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.321425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.321583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.321722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.321896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.322986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.323939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.324974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] role.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] role.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.325961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.326893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.327867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.328984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329064 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] role.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] role.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.329988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.330985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.331940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.332877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.333053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.333214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.333295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.333449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.333528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.333698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.333796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.334971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.335998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.336955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.337909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.connection = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.338882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.339984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.340997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.341976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.connection = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.342930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.343006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80552) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 18:03:35.343079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.343311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.343545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.343778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.344016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.344256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.344489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.344732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.344966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.345213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.345446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.345687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.345939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.346178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.346412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 27 18:03:35.346580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80553) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 27 18:03:35.373870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.374049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.374279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.374460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.374693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.374925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.382721 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.383220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.413244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.413408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.413501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.413589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.465964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.466151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.516859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.517094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.517213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.517448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.587414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.587646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.587873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.588946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.589158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.614410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.614634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.614725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.614852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.614946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.615067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.615758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.615872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.615992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.616075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.616214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.616306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.616434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.616652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.627633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.627827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.640533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.640663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.640777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.640897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.641954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80552) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.642058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80553) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 27 18:03:35.659572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.659781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:03:35.659963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.660116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.660202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:03:35.660319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:03:35.660484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.660591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.660682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 27 18:03:35.660850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.660932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.661105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.661187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.661359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.661449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.661642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.671703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.671943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.672028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.672217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.672301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.672481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.672563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.672759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.679506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.679688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.684221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.684366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.684531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.684647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.684742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.684902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.685978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.686107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.686244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.686377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.686505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.686644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.686768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.686906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.687139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.710492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.710592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.711974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.712073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.712249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.712331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.716875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.717009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.717149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.717289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.717422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.717568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.724038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.724241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.724336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.724571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.729137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.729299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.729422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.729584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.729702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.729894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.730020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.730175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.730290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.730459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.730568 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.730742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.730823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.731008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.731098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.731280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.746959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.747230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.747313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.747565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.751167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.751526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.754321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.754614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.754710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.754971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.759025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.759447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.762308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.762628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.765452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.765745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.765918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.766056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.766213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.766355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.766494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.766627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.766790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.766908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.767081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.767364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.783778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.784055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.784205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.784315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.784487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.784570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.784751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.785009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.792095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.792563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.793624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.793922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.794139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.794415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.796717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.796990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.797253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.797392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.797535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.797676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.797823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.797951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.798105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.798390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.809257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.809532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.809826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.809968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.810113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.810246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.810377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.810508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.810639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.810769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.810910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.811039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.811254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.811526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.826470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.827231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.829447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.830253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.832413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.833216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.835377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.836207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.836941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.837221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.837498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.837725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.838034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.838312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.843951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.844814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.845547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.846434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.848477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.848761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.849040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.849318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.849465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.850255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.850539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.850812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.857922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.858204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.858496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.858953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.859239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.859521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.865328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80553) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.865603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.865898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.866168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.866443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.866581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80552) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 27 18:03:35.866710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.866836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.866962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.867087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.867213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.867356 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.867563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.867690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.867842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.867971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.868106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.868231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.868358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.868484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.868611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.868754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.868897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80553) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.869025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.869264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.869527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.869822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.870083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80552) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 27 18:03:35.902636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642dd8de9c0 pid: 80553 (default app) Jul 27 18:03:35.903905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5642dd8de9c0 pid: 80552 (default app) Jul 27 18:03:35.905844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52a96-ae3e-43cb-af5d-da94952d7fa0 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:35.906132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52a96-ae3e-43cb-af5d-da94952d7fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:35.906404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e52a96-ae3e-43cb-af5d-da94952d7fa0 None None] PATH_INFO: `/v3` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:35.910927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 791 bytes} [Wed Jul 27 18:03:35 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:44.563093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46814b3-a86d-4472-a664-3f1c34514b4e None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.563672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46814b3-a86d-4472-a664-3f1c34514b4e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.563672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46814b3-a86d-4472-a664-3f1c34514b4e None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.568582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1/2] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:03:44.574016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:44.574408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:44.574563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:44.646866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: INFO dbcounter [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] Registered counter for database keystone Jul 27 18:03:44.668153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG oslo_db.sqlalchemy.engines [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80553) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 18:03:44.674372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writer thread running {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 18:03:44.852685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG passlib.handlers.bcrypt [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80553) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 18:03:44.853037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG passlib.handlers.bcrypt [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80553) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 18:03:44.906769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:44.908635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:45.031486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 27 18:03:45.152142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46814b3-a86d-4472-a664-3f1c34514b4e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:45.221420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: INFO dbcounter [None req-a46814b3-a86d-4472-a664-3f1c34514b4e None None] Registered counter for database keystone Jul 27 18:03:45.240927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG oslo_db.sqlalchemy.engines [None req-a46814b3-a86d-4472-a664-3f1c34514b4e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80552) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 27 18:03:45.247049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writer thread running {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 27 18:03:45.362086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46814b3-a86d-4472-a664-3f1c34514b4e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:45.366447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617355f6-915c-4820-91b0-c6f749ce71e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:45.367035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617355f6-915c-4820-91b0-c6f749ce71e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:45.367312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617355f6-915c-4820-91b0-c6f749ce71e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:45.367584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617355f6-915c-4820-91b0-c6f749ce71e8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:45.375516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617355f6-915c-4820-91b0-c6f749ce71e8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:45.427905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING keystone.common.rbac_enforcer.enforcer [None req-617355f6-915c-4820-91b0-c6f749ce71e8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 18:03:45.428241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617355f6-915c-4820-91b0-c6f749ce71e8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:45.437614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Jul 27 18:03:45 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:03:45.443706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:45.458089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70896247-c2a4-4dca-9254-1277de08c10c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:45.463058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a84f4-0a83-4702-bb90-25833e1009e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:45.464169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a84f4-0a83-4702-bb90-25833e1009e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:45.464457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a84f4-0a83-4702-bb90-25833e1009e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:45.464733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a84f4-0a83-4702-bb90-25833e1009e0 admin admin] PATH_INFO: `/v3/projects/92b4949330f5444faa0288f0a88fa18a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:45.466281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a84f4-0a83-4702-bb90-25833e1009e0 admin admin] RBAC: Authorizing `identity:get_project(project_id=92b4949330f5444faa0288f0a88fa18a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:45.516561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING keystone.common.rbac_enforcer.enforcer [None req-579a84f4-0a83-4702-bb90-25833e1009e0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 27 18:03:45.516901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579a84f4-0a83-4702-bb90-25833e1009e0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:45.522123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 3/5] 10.222.0.67 () {56 vars in 1207 bytes} [Wed Jul 27 18:03:45 2022] GET /identity/v3/projects/92b4949330f5444faa0288f0a88fa18a => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:47.472129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2402-5d44-4232-a4fd-5c3ee6cdf58b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:47.472624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2402-5d44-4232-a4fd-5c3ee6cdf58b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:47.472624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2402-5d44-4232-a4fd-5c3ee6cdf58b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:47.476721 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 3/6] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:03:47.482112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3eac-eb78-41d3-865d-16237451c092 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:47.482484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3eac-eb78-41d3-865d-16237451c092 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:47.482660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d3eac-eb78-41d3-865d-16237451c092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:47.504208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a19d3eac-eb78-41d3-865d-16237451c092 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:47.506256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a19d3eac-eb78-41d3-865d-16237451c092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:47.514091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 4/7] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 27 18:03:47.536193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2402-5d44-4232-a4fd-5c3ee6cdf58b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:47.549037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2402-5d44-4232-a4fd-5c3ee6cdf58b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:47.553320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bd57d-5113-4d53-81b5-034480204a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:47.553955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bd57d-5113-4d53-81b5-034480204a45 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:47.554240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bd57d-5113-4d53-81b5-034480204a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:47.554516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bd57d-5113-4d53-81b5-034480204a45 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:47.562223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bd57d-5113-4d53-81b5-034480204a45 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:47.563980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bd57d-5113-4d53-81b5-034480204a45 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:47.573339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1324 bytes} [Wed Jul 27 18:03:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:03:47.578726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3eac-eb78-41d3-865d-16237451c092 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:47.588352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19d3eac-eb78-41d3-865d-16237451c092 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:47.592668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811e5ce-62ae-4373-a9fd-7dc8f1daff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:47.593294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811e5ce-62ae-4373-a9fd-7dc8f1daff07 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:47.593570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811e5ce-62ae-4373-a9fd-7dc8f1daff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:47.593866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811e5ce-62ae-4373-a9fd-7dc8f1daff07 admin admin] PATH_INFO: `/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:47.595219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811e5ce-62ae-4373-a9fd-7dc8f1daff07 admin admin] RBAC: Authorizing `identity:get_user(user_id=3a547ecd2bf446a2aa047f5f9c68c5a5)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:47.597024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811e5ce-62ae-4373-a9fd-7dc8f1daff07 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:47.598582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 5/9] 10.222.0.67 () {56 vars in 1198 bytes} [Wed Jul 27 18:03:47 2022] GET /identity/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:49.629596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aace4-cab3-4410-9840-383a23696b7b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:49.630153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aace4-cab3-4410-9840-383a23696b7b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:49.630153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aace4-cab3-4410-9840-383a23696b7b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:49.632161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 5/10] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:03:49.637286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e0f7-90c8-400b-93c8-d49e4d66fbdd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:49.637717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e0f7-90c8-400b-93c8-d49e4d66fbdd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:49.637896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624e0f7-90c8-400b-93c8-d49e4d66fbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:49.658126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-1624e0f7-90c8-400b-93c8-d49e4d66fbdd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:49.659314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1624e0f7-90c8-400b-93c8-d49e4d66fbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:49.669674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df33cf-03ca-4306-8365-7db5fc22823b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:49.670000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df33cf-03ca-4306-8365-7db5fc22823b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:49.670278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1df33cf-03ca-4306-8365-7db5fc22823b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:49.671619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 6/11] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:03:49.676454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaf626-599e-4d60-a484-908272e195ac None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:49.676739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaf626-599e-4d60-a484-908272e195ac None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:49.677018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deaf626-599e-4d60-a484-908272e195ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:49.719606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG passlib.handlers.bcrypt [None req-3deaf626-599e-4d60-a484-908272e195ac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80552) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 27 18:03:49.720031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG passlib.handlers.bcrypt [None req-3deaf626-599e-4d60-a484-908272e195ac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80552) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 27 18:03:49.739242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 6/12] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:49.762005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e0f7-90c8-400b-93c8-d49e4d66fbdd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:49.765447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3deaf626-599e-4d60-a484-908272e195ac None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:49.767060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3deaf626-599e-4d60-a484-908272e195ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:49.785621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:49.864642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624e0f7-90c8-400b-93c8-d49e4d66fbdd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:49.866712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:03:49.888239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaf626-599e-4d60-a484-908272e195ac None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:49.899606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:49.900256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:49.900538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:49.900814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:49.912376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:03:49.921270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:03:49.922266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:03:49.923326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 7/14] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:03:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:03:49.928699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:49.989057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deaf626-599e-4d60-a484-908272e195ac None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:49.991856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:50.010444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:50.026022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:50.026895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:50.027177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:50.027448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:50.028181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9c68c2-895e-4efb-a5c8-1ad806885228 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:50.063019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:50.063639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:50.063918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:50.064186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:50.064905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:50.065204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:50.066683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:50.081147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 8/15] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:03:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:50.086670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:50.100839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:50.103281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:50.208262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 8/16] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:03:50.214000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:50.217175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:50.289939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c939c0-1149-4595-a654-8ea8c2400bfc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:50.314175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d077617-685f-4c7b-b6b1-c89b059cc43a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:50.323499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:50.324150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:50.324431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:50.324707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] PATH_INFO: `/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:50.325905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] RBAC: Authorizing `identity:get_user(user_id=3a547ecd2bf446a2aa047f5f9c68c5a5)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:50.327370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:50.328984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 9/17] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:03:50 2022] GET /identity/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5 => generated 247 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:50.334382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:50.348773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:50.350053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:50.350632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:50.350905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:50.351167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:50.369726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:50.371682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:03:50.389318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:03:50.390184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:03:50.390969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:03:50.390969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:03:50.390969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:03:50.390969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:03:50.390969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 9/18] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:03:50.396366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:50.434514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bb0c88-7ef6-4605-bc88-0d247c6203e1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:50.451917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:50.467287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:50.467873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:50.468159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:50.468434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:50.469592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:50.471091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:50.472741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 10/19] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:50.479092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:50.495991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e39f470-8624-4ce8-a7e7-4312c86daa30 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:50.528654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9d9a42-6f80-4156-98d1-a1328615d8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:50.529275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d9a42-6f80-4156-98d1-a1328615d8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:50.529556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d9a42-6f80-4156-98d1-a1328615d8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:50.529858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9d9a42-6f80-4156-98d1-a1328615d8e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:50.530553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d9a42-6f80-4156-98d1-a1328615d8e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:50.530857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d9a42-6f80-4156-98d1-a1328615d8e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:50.532333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9d9a42-6f80-4156-98d1-a1328615d8e1 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:50.550558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 10/20] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:50.565147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:50.586766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d11c027-998d-4c85-bebd-d5b74bf5bb0c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:50.623727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18a45d-b757-4def-a64d-96426b6a4322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:50.624360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a45d-b757-4def-a64d-96426b6a4322 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:50.624641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a45d-b757-4def-a64d-96426b6a4322 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:50.624914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18a45d-b757-4def-a64d-96426b6a4322 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:50.625829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a45d-b757-4def-a64d-96426b6a4322 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.domain.id=default, user.id=3a547ecd2bf446a2aa047f5f9c68c5a5) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:50.626167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a45d-b757-4def-a64d-96426b6a4322 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:50.627658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f18a45d-b757-4def-a64d-96426b6a4322 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:50.635241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 11/21] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Jul 27 18:03:50 2022] GET /identity/v3/role_assignments?user.id=3a547ecd2bf446a2aa047f5f9c68c5a5&scope.domain.id=default&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 233 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:52.787902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f506d-afd8-47bc-af01-c1c362d7db19 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:52.788461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f506d-afd8-47bc-af01-c1c362d7db19 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:52.788461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f506d-afd8-47bc-af01-c1c362d7db19 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:52.790124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 11/22] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:03:52.795324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05612-87a5-45bd-a090-2408e6997976 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:52.795722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05612-87a5-45bd-a090-2408e6997976 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:52.795900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa05612-87a5-45bd-a090-2408e6997976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:52.818375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8fa05612-87a5-45bd-a090-2408e6997976 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:52.819574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8fa05612-87a5-45bd-a090-2408e6997976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:52.916208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 12/23] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:52.955328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f506d-afd8-47bc-af01-c1c362d7db19 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:53.012444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa5cea-721b-46a8-87fb-d6d19acc3af0 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.012778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa5cea-721b-46a8-87fb-d6d19acc3af0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.013002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa5cea-721b-46a8-87fb-d6d19acc3af0 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.014394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:03:53.019290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4de07-8aba-40dd-a517-b50087c67cd4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.019575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4de07-8aba-40dd-a517-b50087c67cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.019857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4de07-8aba-40dd-a517-b50087c67cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.063077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-22b4de07-8aba-40dd-a517-b50087c67cd4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:53.064210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-22b4de07-8aba-40dd-a517-b50087c67cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:53.154456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f506d-afd8-47bc-af01-c1c362d7db19 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:53.182119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:53.192119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 14/25] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:53.219445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a190f-e959-4684-b6af-542a3bb819ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:53.220111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a190f-e959-4684-b6af-542a3bb819ca None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.220394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a190f-e959-4684-b6af-542a3bb819ca None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.220668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a190f-e959-4684-b6af-542a3bb819ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.229493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4de07-8aba-40dd-a517-b50087c67cd4 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:53.233321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:53.244068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a190f-e959-4684-b6af-542a3bb819ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-ed9a190f-e959-4684-b6af-542a3bb819ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:03:53.257357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:03:53.258315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:03:53.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 12/26] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:03:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:03:53.260749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664386b6-f5e6-415a-a628-2a27bc209f0c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.261052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664386b6-f5e6-415a-a628-2a27bc209f0c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.261333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664386b6-f5e6-415a-a628-2a27bc209f0c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.262682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:03:53.268344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664386b6-f5e6-415a-a628-2a27bc209f0c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:53.373804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b4de07-8aba-40dd-a517-b50087c67cd4 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:53.402008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664386b6-f5e6-415a-a628-2a27bc209f0c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:53.445109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b6cc3-f52b-4bc9-ba3f-2688c6438802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:53.446039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6cc3-f52b-4bc9-ba3f-2688c6438802 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.446457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6cc3-f52b-4bc9-ba3f-2688c6438802 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.446866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b6cc3-f52b-4bc9-ba3f-2688c6438802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.466366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b6cc3-f52b-4bc9-ba3f-2688c6438802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:53.469049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b6cc3-f52b-4bc9-ba3f-2688c6438802 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:53.473647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:53.475281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.475734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.476527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.478436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:53.479608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:53.483201 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-4d4b6cc3-f52b-4bc9-ba3f-2688c6438802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:03:53.502853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:03:53.503876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:03:53.504873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:03:53.504873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:03:53.504873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:03:53.504873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:03:53.507794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 14/28] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:03:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:53.509150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 15/29] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:03:53.510575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cbf7-f155-43ef-924d-550715e29f91 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.511080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cbf7-f155-43ef-924d-550715e29f91 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.511486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293cbf7-f155-43ef-924d-550715e29f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.514692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:53.545932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-f293cbf7-f155-43ef-924d-550715e29f91 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:53.552084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f293cbf7-f155-43ef-924d-550715e29f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:53.669813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:53.689083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:53.691224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 16/30] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:53.692702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cbf7-f155-43ef-924d-550715e29f91 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:53.753884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf8b02b-d683-4414-849a-b5b6ac68aab7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:53.795838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e5e7ab-9b13-4ac0-bc7e-fa04f44f02fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:53.797258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e7ab-9b13-4ac0-bc7e-fa04f44f02fa None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.797783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e7ab-9b13-4ac0-bc7e-fa04f44f02fa None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.798250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e5e7ab-9b13-4ac0-bc7e-fa04f44f02fa None admin] PATH_INFO: `/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.800042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5e7ab-9b13-4ac0-bc7e-fa04f44f02fa None admin] RBAC: Authorizing `identity:get_user(user_id=3a547ecd2bf446a2aa047f5f9c68c5a5)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:53.801853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e5e7ab-9b13-4ac0-bc7e-fa04f44f02fa None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:53.804486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 15/31] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:03:53 2022] GET /identity/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5 => generated 247 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:53.805848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7941-d39d-422c-9822-a0bfec465bbf None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.806346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7941-d39d-422c-9822-a0bfec465bbf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.806807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c7941-d39d-422c-9822-a0bfec465bbf None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.808203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 16/32] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:03:53.809069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7941-d39d-422c-9822-a0bfec465bbf None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:53.839463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293cbf7-f155-43ef-924d-550715e29f91 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:53.883203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065a935-be56-46b1-893d-174c429ccfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:53.883840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065a935-be56-46b1-893d-174c429ccfff None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.884124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065a935-be56-46b1-893d-174c429ccfff None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.884655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065a935-be56-46b1-893d-174c429ccfff None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.885356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065a935-be56-46b1-893d-174c429ccfff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:53.885661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065a935-be56-46b1-893d-174c429ccfff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:53.887724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065a935-be56-46b1-893d-174c429ccfff None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:53.912918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 17/33] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:53.915071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee031cd3-1cd4-4e36-b782-9bf6b0cff352 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.915367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee031cd3-1cd4-4e36-b782-9bf6b0cff352 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.915652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee031cd3-1cd4-4e36-b782-9bf6b0cff352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.935749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c7941-d39d-422c-9822-a0bfec465bbf None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:53.941134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ee031cd3-1cd4-4e36-b782-9bf6b0cff352 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:53.942364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ee031cd3-1cd4-4e36-b782-9bf6b0cff352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:53.944848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:53.975717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:53.976798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:53.977324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:53.977814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:53.978843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:53.980566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:53.995418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:54.021704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 18/34] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:54.022915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee031cd3-1cd4-4e36-b782-9bf6b0cff352 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:54.139733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee031cd3-1cd4-4e36-b782-9bf6b0cff352 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:54.178876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:54.179948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.180474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.180961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.182368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:54.184110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:54.186090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 19/35] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:54.187018 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:54.232550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 17/36] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 18:03:53 2022] POST /identity/v3/roles => generated 219 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:03:54.233521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:54.239260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:54.303803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed191fae-9114-4d95-9836-8ecf7c9ec440 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:54.343135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec27c-bb36-4b2f-a4ce-8cc75d3a5914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:54.343844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec27c-bb36-4b2f-a4ce-8cc75d3a5914 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.344121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec27c-bb36-4b2f-a4ce-8cc75d3a5914 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.344393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec27c-bb36-4b2f-a4ce-8cc75d3a5914 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.345299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec27c-bb36-4b2f-a4ce-8cc75d3a5914 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:54.347259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec27c-bb36-4b2f-a4ce-8cc75d3a5914 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:54.363538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e81ed89-6892-49e9-972d-23c77defde4f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:54.408849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:54.408849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.408849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.408849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.409242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:54.410719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:54.481132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 18:03:54 2022] POST /identity/v3/roles => generated 225 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:03:54.482019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:54.515744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:54.565983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 20/38] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:03:54 2022] POST /identity/v3/projects => generated 301 bytes in 379 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:03:54.569296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777735-84e9-44fa-a89e-66e7183ba636 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.569725 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777735-84e9-44fa-a89e-66e7183ba636 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.570081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa777735-84e9-44fa-a89e-66e7183ba636 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.571816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 21/39] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:03:54.572954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b04b-0c33-4cee-bbaa-ef7fed1ee6ec None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.573970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b04b-0c33-4cee-bbaa-ef7fed1ee6ec None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.574255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c1b04b-0c33-4cee-bbaa-ef7fed1ee6ec None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.576271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 22/40] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:03:54.577497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d600c5e-0ac6-4c10-912f-696cf45767d9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.578277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d600c5e-0ac6-4c10-912f-696cf45767d9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.578633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d600c5e-0ac6-4c10-912f-696cf45767d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.609047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8d600c5e-0ac6-4c10-912f-696cf45767d9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:54.611109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8d600c5e-0ac6-4c10-912f-696cf45767d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:54.611807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855be1f-f9ae-4686-86b8-3a64c417a98c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:54.655424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:54.656554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.657187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.657997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] PATH_INFO: `/v3/domains/default/users/3a547ecd2bf446a2aa047f5f9c68c5a5/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.660682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=3a547ecd2bf446a2aa047f5f9c68c5a5, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:54.663075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:54.707261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 23/41] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:54.708940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39158e-0569-4d38-b928-1997dc03ef89 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.709231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39158e-0569-4d38-b928-1997dc03ef89 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.709506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39158e-0569-4d38-b928-1997dc03ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.729886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9e39158e-0569-4d38-b928-1997dc03ef89 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:54.731105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9e39158e-0569-4d38-b928-1997dc03ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:54.754717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:54.798108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 19/42] 10.222.0.67 () {58 vars in 1361 bytes} [Wed Jul 27 18:03:54 2022] PUT /identity/v3/domains/default/users/3a547ecd2bf446a2aa047f5f9c68c5a5/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:03:54.799322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:54.808987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 24/43] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:54.832432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39158e-0569-4d38-b928-1997dc03ef89 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:54.902511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:54.918393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc19306-c4c3-4ea2-b88f-0b011f630468 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:54.946028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39158e-0569-4d38-b928-1997dc03ef89 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:54.959886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c067a5-b785-49b6-974d-d0e2c6e2d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:54.960754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c067a5-b785-49b6-974d-d0e2c6e2d674 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.961206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c067a5-b785-49b6-974d-d0e2c6e2d674 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.961625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c067a5-b785-49b6-974d-d0e2c6e2d674 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.962516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c067a5-b785-49b6-974d-d0e2c6e2d674 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:54.964059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c067a5-b785-49b6-974d-d0e2c6e2d674 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:54.986429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:54.987126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:54.987410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:54.987684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:54.988823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:54.990471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:54.992307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 25/44] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:54.997607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:55.023495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:55.038090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 20/45] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 18:03:54 2022] POST /identity/v3/roles => generated 223 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:03:55.109401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dee033-c385-4809-bfbd-75d4517bdcc8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:55.148001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de5fb5f-53a7-4cba-885d-d18f484ed3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:55.148648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5fb5f-53a7-4cba-885d-d18f484ed3e0 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:55.148933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5fb5f-53a7-4cba-885d-d18f484ed3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:55.149274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de5fb5f-53a7-4cba-885d-d18f484ed3e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:55.150005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5fb5f-53a7-4cba-885d-d18f484ed3e0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:55.151560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de5fb5f-53a7-4cba-885d-d18f484ed3e0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:55.242075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 26/46] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:03:54 2022] POST /identity/v3/projects => generated 312 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:03:56.821324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2a8b7-4233-47ec-a62b-599e923bd168 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:56.821863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2a8b7-4233-47ec-a62b-599e923bd168 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:56.821946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc2a8b7-4233-47ec-a62b-599e923bd168 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:56.823291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 21/47] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:03:56.828554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe706ef-47bd-41bd-ae7a-a671adbd6c68 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:56.828969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe706ef-47bd-41bd-ae7a-a671adbd6c68 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:56.829121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe706ef-47bd-41bd-ae7a-a671adbd6c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:56.847354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-dfe706ef-47bd-41bd-ae7a-a671adbd6c68 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:56.848534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-dfe706ef-47bd-41bd-ae7a-a671adbd6c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:56.916136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 27/48] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:56.938311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2a8b7-4233-47ec-a62b-599e923bd168 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:57.038217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc2a8b7-4233-47ec-a62b-599e923bd168 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:57.070683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:57.071323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.071655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.071878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.082388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:03:57.087934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:03:57.088947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:03:57.089738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 22/49] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:03:57.096341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe706ef-47bd-41bd-ae7a-a671adbd6c68 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:57.104805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:57.195837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe706ef-47bd-41bd-ae7a-a671adbd6c68 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:57.228782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2af2861-03fd-4b6a-822d-d0e132a49f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:57.229410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2861-03fd-4b6a-822d-d0e132a49f88 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.229694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2861-03fd-4b6a-822d-d0e132a49f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.230000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2af2861-03fd-4b6a-822d-d0e132a49f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.230713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af2861-03fd-4b6a-822d-d0e132a49f88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:57.231017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af2861-03fd-4b6a-822d-d0e132a49f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:57.232390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2af2861-03fd-4b6a-822d-d0e132a49f88 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:57.240711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 28/50] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:03:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:57.246389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:57.251491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fe5ad-ecc9-413e-890f-3afbe3159436 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.251779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fe5ad-ecc9-413e-890f-3afbe3159436 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.252059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239fe5ad-ecc9-413e-890f-3afbe3159436 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.253377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 29/51] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:03:57.257226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:57.258979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc29e2-ef29-4ecc-872f-098fb7765773 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.259261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc29e2-ef29-4ecc-872f-098fb7765773 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.259542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc29e2-ef29-4ecc-872f-098fb7765773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.277637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-92cc29e2-ef29-4ecc-872f-098fb7765773 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:57.278946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-92cc29e2-ef29-4ecc-872f-098fb7765773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:57.340977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:57.346243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 30/52] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:03:57.347694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b389441-fdfa-45b1-a517-42227cbdeee4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:57.368834 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc29e2-ef29-4ecc-872f-098fb7765773 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:57.382017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:57.382660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.382946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.383223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] PATH_INFO: `/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.384388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] RBAC: Authorizing `identity:get_user(user_id=3a547ecd2bf446a2aa047f5f9c68c5a5)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:57.385867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:57.387500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 23/53] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:03:57 2022] GET /identity/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5 => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:57.392701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:57.466870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc29e2-ef29-4ecc-872f-098fb7765773 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:57.467648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:57.492228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6b6ae-0a01-4d8a-9fe1-c7537d8c2581 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:57.500428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:57.501070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.501420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.501699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.502879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:57.504336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:57.506795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 31/54] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:03:57.512110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:57.526759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:57.527395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.527717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.527998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.529149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:57.530605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:57.532195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 24/55] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:57.538027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:57.579310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:57.611760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f65088e-d5dc-482a-92b6-ae177f31475f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:57.642709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967571fb-df2b-4507-ae7e-7e6482285aaf None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:57.647796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d26c76-7832-477d-90c0-8fc65154dd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:57.648420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d26c76-7832-477d-90c0-8fc65154dd6c None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.648697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d26c76-7832-477d-90c0-8fc65154dd6c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.648965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d26c76-7832-477d-90c0-8fc65154dd6c None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.649636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d26c76-7832-477d-90c0-8fc65154dd6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:57.651134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d26c76-7832-477d-90c0-8fc65154dd6c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:57.675494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d606ca-dc54-41a8-a5dc-eb3a7ebeed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:57.676108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d606ca-dc54-41a8-a5dc-eb3a7ebeed5d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:57.677631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d606ca-dc54-41a8-a5dc-eb3a7ebeed5d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:57.677631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d606ca-dc54-41a8-a5dc-eb3a7ebeed5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:57.677970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d606ca-dc54-41a8-a5dc-eb3a7ebeed5d None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.domain.id=default, user.id=3a547ecd2bf446a2aa047f5f9c68c5a5) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:03:57.678279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d606ca-dc54-41a8-a5dc-eb3a7ebeed5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:57.679695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d606ca-dc54-41a8-a5dc-eb3a7ebeed5d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:57.687492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 25/56] 10.222.0.67 () {56 vars in 1322 bytes} [Wed Jul 27 18:03:57 2022] GET /identity/v3/role_assignments?user.id=3a547ecd2bf446a2aa047f5f9c68c5a5&scope.domain.id=default&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:03:57.732795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 32/57] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Jul 27 18:03:57 2022] POST /identity/v3/projects => generated 298 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:03:59.743183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e4cf-ee41-4ca4-bde6-37b5b637b8f6 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:59.743725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e4cf-ee41-4ca4-bde6-37b5b637b8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:59.743725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f9e4cf-ee41-4ca4-bde6-37b5b637b8f6 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:59.745124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 26/58] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:03:59.750313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ebf41-6e58-4021-90d4-a8b15ed6e003 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:59.750681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ebf41-6e58-4021-90d4-a8b15ed6e003 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:59.750863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13ebf41-6e58-4021-90d4-a8b15ed6e003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:59.768666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a13ebf41-6e58-4021-90d4-a8b15ed6e003 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:03:59.769861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a13ebf41-6e58-4021-90d4-a8b15ed6e003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:03:59.834033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 33/59] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:03:59.857350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e4cf-ee41-4ca4-bde6-37b5b637b8f6 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:03:59.867058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:03:59.958765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f9e4cf-ee41-4ca4-bde6-37b5b637b8f6 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:03:59.990873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c2607f-1b93-4a69-9a78-815ebe1fba1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:03:59.991502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2607f-1b93-4a69-9a78-815ebe1fba1b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:03:59.991789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2607f-1b93-4a69-9a78-815ebe1fba1b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:03:59.992065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c2607f-1b93-4a69-9a78-815ebe1fba1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:03:59.993267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2607f-1b93-4a69-9a78-815ebe1fba1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:03:59.994699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c2607f-1b93-4a69-9a78-815ebe1fba1b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:03:59.996303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 27/60] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:00.001715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ebf41-6e58-4021-90d4-a8b15ed6e003 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:00.048835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:00.098147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13ebf41-6e58-4021-90d4-a8b15ed6e003 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:00.132967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88195bdb-256b-44b6-ab15-8bad72f8f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:00.133599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195bdb-256b-44b6-ab15-8bad72f8f00b None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:00.133923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195bdb-256b-44b6-ab15-8bad72f8f00b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:00.134206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88195bdb-256b-44b6-ab15-8bad72f8f00b None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:00.134905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88195bdb-256b-44b6-ab15-8bad72f8f00b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:00.136364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88195bdb-256b-44b6-ab15-8bad72f8f00b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:00.279101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 34/61] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:00 2022] POST /identity/v3/users => generated 275 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:03.281873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e13832-6775-4e5a-a27a-0968add13862 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.282679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e13832-6775-4e5a-a27a-0968add13862 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.282679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e13832-6775-4e5a-a27a-0968add13862 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.284176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 28/62] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:03.289248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8a2da-657c-4525-af16-eb6e95fd56c5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.290192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8a2da-657c-4525-af16-eb6e95fd56c5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.290693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8a2da-657c-4525-af16-eb6e95fd56c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.318780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-f3d8a2da-657c-4525-af16-eb6e95fd56c5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:03.320340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f3d8a2da-657c-4525-af16-eb6e95fd56c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:03.412181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 35/63] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:03.453973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e13832-6775-4e5a-a27a-0968add13862 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:03.512819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7c702-df4b-48d3-8548-3f662a55a1d3 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.513468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7c702-df4b-48d3-8548-3f662a55a1d3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.513985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee7c702-df4b-48d3-8548-3f662a55a1d3 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.515563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 36/64] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:03.520936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc27618-f880-4a10-8a2b-fe30f2343c14 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.521494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc27618-f880-4a10-8a2b-fe30f2343c14 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.522027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc27618-f880-4a10-8a2b-fe30f2343c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.550557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-dcc27618-f880-4a10-8a2b-fe30f2343c14 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:03.553292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-dcc27618-f880-4a10-8a2b-fe30f2343c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:03.577325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:03.610615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:03.623586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e13832-6775-4e5a-a27a-0968add13862 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:03.671018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:03.671736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 37/65] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:03.678159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.678159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.678159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.680835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a1b7b-b172-4579-a57f-41308139a3cd None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.681120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a1b7b-b172-4579-a57f-41308139a3cd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.681397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a1b7b-b172-4579-a57f-41308139a3cd None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.682926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 38/66] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:03.691115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba9fc0-1475-4b2e-9cd7-88e0c7a927dd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.691393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba9fc0-1475-4b2e-9cd7-88e0c7a927dd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.691673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba9fc0-1475-4b2e-9cd7-88e0c7a927dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.700879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:03.707597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:03.708577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 29/67] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:03.709782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:03.722597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-33ba9fc0-1475-4b2e-9cd7-88e0c7a927dd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:03.724180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-33ba9fc0-1475-4b2e-9cd7-88e0c7a927dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:03.805742 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 39/68] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:03.806617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba9fc0-1475-4b2e-9cd7-88e0c7a927dd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:03.848224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f4366-6b49-40a9-9edc-60ad732520e7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:03.888373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c813e4a-dbf8-47be-9431-85ef1de0de6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:03.889052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c813e4a-dbf8-47be-9431-85ef1de0de6f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.889342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c813e4a-dbf8-47be-9431-85ef1de0de6f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.889619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c813e4a-dbf8-47be-9431-85ef1de0de6f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.891521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:03.901098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c813e4a-dbf8-47be-9431-85ef1de0de6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-9c813e4a-dbf8-47be-9431-85ef1de0de6f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:03.907061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:03.908204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:03.908944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 30/69] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:03.910015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655a0b-faab-4815-a1d5-c1b2053831f4 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.910015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655a0b-faab-4815-a1d5-c1b2053831f4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.910204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09655a0b-faab-4815-a1d5-c1b2053831f4 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.911683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 31/70] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:03.912226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09655a0b-faab-4815-a1d5-c1b2053831f4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:03.917895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:03.929749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba9fc0-1475-4b2e-9cd7-88e0c7a927dd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:03.964207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec878b2-8f77-4240-886c-7cfdf64c8915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:03.964839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec878b2-8f77-4240-886c-7cfdf64c8915 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.965124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec878b2-8f77-4240-886c-7cfdf64c8915 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.965399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec878b2-8f77-4240-886c-7cfdf64c8915 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.966158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec878b2-8f77-4240-886c-7cfdf64c8915 None admin] RBAC: Adding query filter params (name=member) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:03.966467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec878b2-8f77-4240-886c-7cfdf64c8915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:03.967865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec878b2-8f77-4240-886c-7cfdf64c8915 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:03.976975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 40/71] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:03.978155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27961cf-7550-44cf-b8b2-5bc3bf7c5f90 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:03.978442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27961cf-7550-44cf-b8b2-5bc3bf7c5f90 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:03.978721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27961cf-7550-44cf-b8b2-5bc3bf7c5f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:03.996289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a27961cf-7550-44cf-b8b2-5bc3bf7c5f90 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:03.997484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a27961cf-7550-44cf-b8b2-5bc3bf7c5f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:04.026018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09655a0b-faab-4815-a1d5-c1b2053831f4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.062414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.063062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.063338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.063720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.069369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 41/72] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:04.070411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27961cf-7550-44cf-b8b2-5bc3bf7c5f90 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.084792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:04.091275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:04.092128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:04.092863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 32/73] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:04.094244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.151530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.158474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.173152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27961cf-7550-44cf-b8b2-5bc3bf7c5f90 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.196214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75265b79-4d90-46c6-8e7a-5b1cc44b431e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.205614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.206282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.206567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.206846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.207565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:04.208360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.209795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.217639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 42/74] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:04.218282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.231208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0405b5-d410-4400-a79e-b55f6ac86f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.231848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0405b5-d410-4400-a79e-b55f6ac86f1d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.232126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0405b5-d410-4400-a79e-b55f6ac86f1d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.232396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0405b5-d410-4400-a79e-b55f6ac86f1d None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.248007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0405b5-d410-4400-a79e-b55f6ac86f1d None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.249486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0405b5-d410-4400-a79e-b55f6ac86f1d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.251174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 33/75] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:04.252335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137aca-710e-4b55-91cc-f98c17f0b5c2 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.252619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137aca-710e-4b55-91cc-f98c17f0b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.252893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d137aca-710e-4b55-91cc-f98c17f0b5c2 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.254145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 34/76] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:04.254899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d137aca-710e-4b55-91cc-f98c17f0b5c2 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.320554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504e353-95e8-419f-8893-4669b18ad427 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.353670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.354337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.354618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.354889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.355445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d137aca-710e-4b55-91cc-f98c17f0b5c2 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.364597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:04.368825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:04.369845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:04.370831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:04.371595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 43/77] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:04.372214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.382058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.395102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.396223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.396596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.396880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.397598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:04.397942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.399339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.408530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 35/78] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:04.410093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.469334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025308c-ac98-4d10-afeb-873901334a91 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.502034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b26e25-44d2-493a-b951-722f8548ccca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.502993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26e25-44d2-493a-b951-722f8548ccca None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.503298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26e25-44d2-493a-b951-722f8548ccca None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.503578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b26e25-44d2-493a-b951-722f8548ccca None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.504772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26e25-44d2-493a-b951-722f8548ccca None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.506284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b26e25-44d2-493a-b951-722f8548ccca None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.507884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa776d72-792d-4d90-afb2-4682eec637a8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.508014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 44/79] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:04.508979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7a4-968c-44a4-b81f-784ea9ac21f0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.509262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7a4-968c-44a4-b81f-784ea9ac21f0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.509542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acc7a4-968c-44a4-b81f-784ea9ac21f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.526989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-04acc7a4-968c-44a4-b81f-784ea9ac21f0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:04.528171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-04acc7a4-968c-44a4-b81f-784ea9ac21f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:04.542561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.543181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.543466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.543743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.586763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.593533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 45/80] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:04.598820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc7a4-968c-44a4-b81f-784ea9ac21f0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.612225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.612744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.614282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.702532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acc7a4-968c-44a4-b81f-784ea9ac21f0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.715392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 36/81] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:04.716052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.738020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.738641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.738926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.739845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.740291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] RBAC: Adding query filter params (name=member) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:04.740594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.741991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.749736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 46/82] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:04.754569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.789015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.812999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da8273b-6231-48b6-9170-620ada29705c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.821420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:04.846553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.847194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.847478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.847760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] PATH_INFO: `/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.849422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] RBAC: Authorizing `identity:get_user(user_id=3a547ecd2bf446a2aa047f5f9c68c5a5)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.851014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.852634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 37/83] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:04.857256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:04.857333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22fa0c-61d0-4ace-86c0-7595b84a5b24 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.887615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.888233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.888516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.888792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.954448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676038d2-582d-4f0b-810e-533abd8e9042 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:04.958354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.959821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.988559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:04.989169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:04.989449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:04.989727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:04.990919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:04.992338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:04.993960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 38/84] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:04.994713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.006621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.024550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.057842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 47/85] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:05.058710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.094080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ba64b-61d0-4a79-9524-b6f58428c4cc None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.128409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.129060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.129345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.129637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.131444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.132912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.134641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 39/86] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:04 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:05.135416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.162061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd924720-4d80-4a4a-a809-4e27b368d382 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.195553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.196192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.196474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.196750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.197967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.199414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.201016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 48/87] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:05.201750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.216765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.235126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.237308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec5e42-d19c-43a3-b537-29da582633cd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.272132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.272681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.272965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.273243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.299078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cce3275-9b29-42ea-892b-175ec7cb616d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.335704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.336347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.336602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.336878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.337553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.339096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.339744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.341242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.416445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.435796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 49/88] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:05 2022] POST /identity/v3/users => generated 289 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:05.436617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.438211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 40/89] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:05.438672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.549134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674571ac-d359-42d9-b940-c7d52d8ba312 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.563350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.574203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b5efb-36fa-42a3-b974-d9ca201fa131 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.586389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.587103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.587388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.587664 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.588459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=34e0b348981c423682cfee52e46660f4) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:05.588777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.590296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.596535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 41/90] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/role_assignments?user.id=34e0b348981c423682cfee52e46660f4&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:05.597191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.621226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.621970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.622258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.622533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.624569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.626105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.628515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 50/91] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:05.628716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.677186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.758575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df463aa9-660b-4c2f-9126-d9642469f67e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.767457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9a09e-8b21-4884-bf3b-ae32b09fc896 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.805971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.806877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.807364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.807788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.809186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.810852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.812928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 51/92] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:05.813910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:05.814133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.814825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.815111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.815387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.846539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.904395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.905653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.933969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8331c76-649c-4c84-9b38-63dcd2d89ee5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:05.961325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:05.975962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:05.976733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:05.977087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:05.977430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:05.978335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] RBAC: Adding query filter params (role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=34e0b348981c423682cfee52e46660f4) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:05.978713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:05.980215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:05.986309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 52/93] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/role_assignments?user.id=34e0b348981c423682cfee52e46660f4&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=2553b3a661e245038eb65b3da25540d8 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:05.987260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:06.042409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 42/94] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:06.051048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:06.137645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:06.151829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038159b2-8801-43d5-b8cd-14a02f123da8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:06.160464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ad820-1e3a-4aed-901c-2594be03b764 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:06.200511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:06.201174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:06.201459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:06.201738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] PATH_INFO: `/v3/projects/52c0e61899ca43559ec42c52bfba578f` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:06.203536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] RBAC: Authorizing `identity:get_project(project_id=52c0e61899ca43559ec42c52bfba578f)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:06.205285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:06.207397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 43/95] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:06 2022] GET /identity/v3/projects/52c0e61899ca43559ec42c52bfba578f => generated 312 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:06.215750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:06.223240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac855c73-c453-4bc4-9912-3444bef0f301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:06.224437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855c73-c453-4bc4-9912-3444bef0f301 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:06.224717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855c73-c453-4bc4-9912-3444bef0f301 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:06.224993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac855c73-c453-4bc4-9912-3444bef0f301 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:06.225832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac855c73-c453-4bc4-9912-3444bef0f301 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=3a547ecd2bf446a2aa047f5f9c68c5a5) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:06.226331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac855c73-c453-4bc4-9912-3444bef0f301 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:06.227937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac855c73-c453-4bc4-9912-3444bef0f301 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:06.239972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:06.241671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 53/96] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:05 2022] GET /identity/v3/role_assignments?user.id=3a547ecd2bf446a2aa047f5f9c68c5a5&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:06.406747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5367e6b2-3d27-438b-ae9d-0fbbbf5b59a7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:06.461807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f792999b-185e-41df-81b3-124ae1773c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:06.462421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792999b-185e-41df-81b3-124ae1773c61 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:06.462712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792999b-185e-41df-81b3-124ae1773c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:06.462991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f792999b-185e-41df-81b3-124ae1773c61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:06.463798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792999b-185e-41df-81b3-124ae1773c61 None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=52c0e61899ca43559ec42c52bfba578f, user.id=34e0b348981c423682cfee52e46660f4) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:06.464114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792999b-185e-41df-81b3-124ae1773c61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:06.465588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f792999b-185e-41df-81b3-124ae1773c61 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:06.478514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 44/97] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:06 2022] GET /identity/v3/role_assignments?user.id=34e0b348981c423682cfee52e46660f4&scope.project.id=52c0e61899ca43559ec42c52bfba578f&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:08.335694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2b40-cdee-443c-9e7f-4338290dd461 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:08.336191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2b40-cdee-443c-9e7f-4338290dd461 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:08.336367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb2b40-cdee-443c-9e7f-4338290dd461 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:08.337727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 54/98] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:08.343077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ee610-00fe-4274-970b-4b7bf1ea182d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:08.343477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ee610-00fe-4274-970b-4b7bf1ea182d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:08.343823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ee610-00fe-4274-970b-4b7bf1ea182d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:08.370820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4d2ee610-00fe-4274-970b-4b7bf1ea182d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:08.372274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4d2ee610-00fe-4274-970b-4b7bf1ea182d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:08.461268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 45/99] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:08.499764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb2b40-cdee-443c-9e7f-4338290dd461 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:08.566255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c0846-9c8f-4b60-b11a-e953a6524d14 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:08.566568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c0846-9c8f-4b60-b11a-e953a6524d14 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:08.566812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c0846-9c8f-4b60-b11a-e953a6524d14 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:08.568861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 46/100] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:08.574723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708ef0-1d4b-4da9-b4f4-f80dae8cb0a1 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:08.575537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708ef0-1d4b-4da9-b4f4-f80dae8cb0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:08.576022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08708ef0-1d4b-4da9-b4f4-f80dae8cb0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:08.586123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:08.598945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-08708ef0-1d4b-4da9-b4f4-f80dae8cb0a1 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:08.600434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-08708ef0-1d4b-4da9-b4f4-f80dae8cb0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:08.653660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb2b40-cdee-443c-9e7f-4338290dd461 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:08.722418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 47/101] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:08.724283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:08.725187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:08.725662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:08.726246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:08.727625 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:08.729298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:08.731390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 55/102] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:08.737076 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08708ef0-1d4b-4da9-b4f4-f80dae8cb0a1 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:08.771699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:08.816909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:08.914243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08708ef0-1d4b-4da9-b4f4-f80dae8cb0a1 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:08.947475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b44be-9584-4253-ba8b-b58494f5ce6a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:08.989862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aae0637-87ab-490d-a1c8-edb67633b47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:08.991904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0637-87ab-490d-a1c8-edb67633b47b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:08.992196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0637-87ab-490d-a1c8-edb67633b47b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:08.992474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aae0637-87ab-490d-a1c8-edb67633b47b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.003802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.004500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.005304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.005579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.006320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:09.007774 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:09.012123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aae0637-87ab-490d-a1c8-edb67633b47b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:09.014022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-3aae0637-87ab-490d-a1c8-edb67633b47b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:09.018531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:09.019561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:09.020885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 56/103] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:09.027280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4798-772e-40a7-9366-57d1b4b46afc None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.027280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4798-772e-40a7-9366-57d1b4b46afc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.027280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115c4798-772e-40a7-9366-57d1b4b46afc None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.027280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 57/104] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:09.027280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d90c4-9dee-471a-aae6-3fdc75d1b2fd None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.027280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d90c4-9dee-471a-aae6-3fdc75d1b2fd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.027839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d90c4-9dee-471a-aae6-3fdc75d1b2fd None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.027839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 58/105] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:09.031122 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a4b0-6e4a-4944-9bfb-61663df7f304 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.031467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a4b0-6e4a-4944-9bfb-61663df7f304 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.031752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c4a4b0-6e4a-4944-9bfb-61663df7f304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.050752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-04c4a4b0-6e4a-4944-9bfb-61663df7f304 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:09.051957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-04c4a4b0-6e4a-4944-9bfb-61663df7f304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:09.097783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 48/106] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:04:08 2022] POST /identity/v3/projects => generated 302 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:09.101231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.148688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 59/107] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:09.150284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a70-6225-40d2-83cc-506071bb621d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.150806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a70-6225-40d2-83cc-506071bb621d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.151225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d9a70-6225-40d2-83cc-506071bb621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.172168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-117d9a70-6225-40d2-83cc-506071bb621d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:09.173699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-117d9a70-6225-40d2-83cc-506071bb621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:09.188908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:09.239015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f3bdb-6936-4c48-aecd-c8eac708e610 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:09.254133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 60/108] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:09.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b40e8-cca4-4bd9-be75-e9c793883b7c None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b40e8-cca4-4bd9-be75-e9c793883b7c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b40e8-cca4-4bd9-be75-e9c793883b7c None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 61/109] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:09.259042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b40e8-cca4-4bd9-be75-e9c793883b7c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.296106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e411905-5d7b-4caa-8ebe-c8ebd7b8b62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.296738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e411905-5d7b-4caa-8ebe-c8ebd7b8b62f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.297025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e411905-5d7b-4caa-8ebe-c8ebd7b8b62f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.297304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e411905-5d7b-4caa-8ebe-c8ebd7b8b62f None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.298066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e411905-5d7b-4caa-8ebe-c8ebd7b8b62f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:09.298377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e411905-5d7b-4caa-8ebe-c8ebd7b8b62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:09.299764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e411905-5d7b-4caa-8ebe-c8ebd7b8b62f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:09.309155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 49/110] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:09.310305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f6e31-1b4f-4651-8ece-7133ddf76a36 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.312121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f6e31-1b4f-4651-8ece-7133ddf76a36 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.312121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f6e31-1b4f-4651-8ece-7133ddf76a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.350917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-313f6e31-1b4f-4651-8ece-7133ddf76a36 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:09.352411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-313f6e31-1b4f-4651-8ece-7133ddf76a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:09.414929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:09.447607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 50/111] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:09.448216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f6e31-1b4f-4651-8ece-7133ddf76a36 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.450785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b40e8-cca4-4bd9-be75-e9c793883b7c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:09.508965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.509622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.509939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.510219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.523754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:09.530414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:09.531250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 62/112] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:09.537057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.538256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:09.584406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f6e31-1b4f-4651-8ece-7133ddf76a36 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:09.621730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.622550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.622898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.623234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.640470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:09.647400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:09.648286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:09.649107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 51/113] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:09.649730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.670945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9b0f0-74b6-4b89-b59c-7c79281fac4e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:09.695008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:09.709035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.709035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.709035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.709035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] PATH_INFO: `/v3/users/9f6328653e72478c9700e681c85b3b8a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.725264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6328653e72478c9700e681c85b3b8a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:09.726966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:09.728803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 63/114] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/users/9f6328653e72478c9700e681c85b3b8a => generated 289 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:09.733292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.769658 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2600d77b-6ab8-43a4-bc70-a59618176056 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:09.800811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:09.805156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.805828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.806113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.806388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.816689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:09.822202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:09.823227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 52/115] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:09.824506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.850398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af5a95-9e05-40c3-a99c-7cc4e1bd7fa4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:09.887857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fbb054-6e50-4fdf-9f00-fa946cf01662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.888476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbb054-6e50-4fdf-9f00-fa946cf01662 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.888823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbb054-6e50-4fdf-9f00-fa946cf01662 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.889114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fbb054-6e50-4fdf-9f00-fa946cf01662 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.889984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbb054-6e50-4fdf-9f00-fa946cf01662 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:09.890295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbb054-6e50-4fdf-9f00-fa946cf01662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:09.891841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fbb054-6e50-4fdf-9f00-fa946cf01662 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:09.901150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 64/116] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:09.905881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac265a5-5cef-4245-9e6c-ab2de69f25c3 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.905881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac265a5-5cef-4245-9e6c-ab2de69f25c3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.905881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac265a5-5cef-4245-9e6c-ab2de69f25c3 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.905881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 65/117] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:09.905881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac265a5-5cef-4245-9e6c-ab2de69f25c3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:09.930018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:09.934114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2647160-0535-4bda-b2bd-2b3193593bb8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:09.972842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:09.973449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:09.973737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:09.974050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:09.974771 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:09.975080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:09.976480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:09.985048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 53/118] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:09.985862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.017167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac265a5-5cef-4245-9e6c-ab2de69f25c3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.044985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.055398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8a3b60-e213-4c47-a51f-79843a3cfb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.056027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3b60-e213-4c47-a51f-79843a3cfb0d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.056310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3b60-e213-4c47-a51f-79843a3cfb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.056586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8a3b60-e213-4c47-a51f-79843a3cfb0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.094158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e8c42c-4eed-428a-8071-4f9d263ff852 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.128694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3b60-e213-4c47-a51f-79843a3cfb0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.130251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8a3b60-e213-4c47-a51f-79843a3cfb0d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.134813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.135438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.135721 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.135997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.136712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:10.137019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.138564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.148359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 54/119] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.149262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.175081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.244613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 66/120] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:10.245915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa5503-d5e1-4813-92ec-1f0e4d23ede9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.246209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa5503-d5e1-4813-92ec-1f0e4d23ede9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.246488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fa5503-d5e1-4813-92ec-1f0e4d23ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.256860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994e8c22-e0bf-4013-80d9-87ba9e76e2b0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.264999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-01fa5503-d5e1-4813-92ec-1f0e4d23ede9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:10.266225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-01fa5503-d5e1-4813-92ec-1f0e4d23ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:10.287870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.296209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.297072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.297551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.298059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.299430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.301043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.303428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 55/121] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.304394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.345038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 67/122] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:10.345963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa5503-d5e1-4813-92ec-1f0e4d23ede9 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.408298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.418602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93fb804-bc46-4ccb-8889-4a197ac93fdd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.454900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.455547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.455829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.456106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.457318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.458918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.459179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fa5503-d5e1-4813-92ec-1f0e4d23ede9 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.460549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 56/123] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.463496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.494541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.495233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.495467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.495745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.496908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.498411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.505084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 68/124] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.505084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.526124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.574182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5e3ebd-8bb7-4e15-ae71-112c52add362 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.609030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.609679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.609991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.610269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.611432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.612041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9af41-d5f7-4cc2-bb0c-a99e5c9f1d25 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.612873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.614667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 57/125] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.615433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.644247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.655019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.655736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.656026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.661663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.661663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.661663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.661663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 69/126] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.662340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.726454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49431a0-6a25-47a6-a5e4-99a1cd285a8c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.761325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.761490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.762066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.762353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.762625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.772064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0edac2-6371-4438-add2-9a2e1cf645af None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.772840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:10.778224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:10.779182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:10.780032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 58/127] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:10.780661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.815655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.816680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.817184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.817853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] PATH_INFO: `/v3/projects/52c0e61899ca43559ec42c52bfba578f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.819032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] RBAC: Authorizing `identity:get_project(project_id=52c0e61899ca43559ec42c52bfba578f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.820482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.826773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 70/128] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/projects/52c0e61899ca43559ec42c52bfba578f => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.826773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.878905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:10.893995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f097b59-17a6-4e77-9f85-1994bcf34460 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.929590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.930312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.930599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.930879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.932057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.933496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.935398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a9e450-df69-4369-a49c-33a9691ff1ef None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:10.935508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 59/129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.936019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:10.975524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:10.976150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:10.976436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:10.976714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:10.977500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] RBAC: Adding query filter params (role.id=837a0f6aa3e341639e303783696f19e6, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=9f6328653e72478c9700e681c85b3b8a) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:10.977836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:10.979384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:10.989799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 71/130] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/role_assignments?user.id=9f6328653e72478c9700e681c85b3b8a&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=837a0f6aa3e341639e303783696f19e6 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:10.989799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:11.037524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:11.054362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6387be51-1008-4653-8ad4-a1919b765360 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:11.094190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:11.094974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.095325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.095671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d/users/34e0b348981c423682cfee52e46660f4/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.098314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] RBAC: Authorizing `identity:create_grant(project_id=95fac151c01642568d306e172fe51b4d, user_id=34e0b348981c423682cfee52e46660f4, role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:11.099916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:11.148484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d596e-5788-490b-bd40-8e1dd39a86a3 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:11.190981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 60/131] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:10 2022] PUT /identity/v3/projects/95fac151c01642568d306e172fe51b4d/users/34e0b348981c423682cfee52e46660f4/roles/2553b3a661e245038eb65b3da25540d8 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:11.191656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:11.193445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:11.194194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.194537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.195167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.197146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:11.197478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:11.199097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:11.211537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:11.214102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 72/132] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:11.215040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:11.325846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdaee8-7456-45a8-9a3d-9fb2a6f26c5d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:11.342923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:11.361570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d58309-4070-492f-b9ae-9dcc4fb04a78 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:11.370284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de00b1-d5fe-4726-bcd8-db47b7e9b822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:11.370977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de00b1-d5fe-4726-bcd8-db47b7e9b822 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.371258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de00b1-d5fe-4726-bcd8-db47b7e9b822 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.371536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de00b1-d5fe-4726-bcd8-db47b7e9b822 None admin] PATH_INFO: `/v3/projects/52c0e61899ca43559ec42c52bfba578f/users/34e0b348981c423682cfee52e46660f4/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.373726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de00b1-d5fe-4726-bcd8-db47b7e9b822 None admin] RBAC: Authorizing `identity:create_grant(project_id=52c0e61899ca43559ec42c52bfba578f, user_id=34e0b348981c423682cfee52e46660f4, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:11.375230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de00b1-d5fe-4726-bcd8-db47b7e9b822 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:11.404640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95244a19-a143-4958-88d4-b731d79aa24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:11.405330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95244a19-a143-4958-88d4-b731d79aa24a None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.405694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95244a19-a143-4958-88d4-b731d79aa24a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.406055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95244a19-a143-4958-88d4-b731d79aa24a None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d/users/34e0b348981c423682cfee52e46660f4/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.408282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95244a19-a143-4958-88d4-b731d79aa24a None admin] RBAC: Authorizing `identity:create_grant(project_id=95fac151c01642568d306e172fe51b4d, user_id=34e0b348981c423682cfee52e46660f4, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:11.409724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95244a19-a143-4958-88d4-b731d79aa24a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:11.460278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 61/133] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:11 2022] PUT /identity/v3/projects/52c0e61899ca43559ec42c52bfba578f/users/34e0b348981c423682cfee52e46660f4/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:11.461893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25fea7-8f46-45ee-9e37-85b30d3f86c5 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.461893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25fea7-8f46-45ee-9e37-85b30d3f86c5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.462071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f25fea7-8f46-45ee-9e37-85b30d3f86c5 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.463429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 62/134] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:11.464010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25fea7-8f46-45ee-9e37-85b30d3f86c5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:11.483652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 73/135] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:11 2022] PUT /identity/v3/projects/95fac151c01642568d306e172fe51b4d/users/34e0b348981c423682cfee52e46660f4/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:11.487722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666af6-a152-4569-b35d-96fab29d10e6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.487722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666af6-a152-4569-b35d-96fab29d10e6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.487722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666af6-a152-4569-b35d-96fab29d10e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.526067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8e666af6-a152-4569-b35d-96fab29d10e6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:11.529193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8e666af6-a152-4569-b35d-96fab29d10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:11.635549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:11.693613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 74/136] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:11.702925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f25fea7-8f46-45ee-9e37-85b30d3f86c5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:11.724063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666af6-a152-4569-b35d-96fab29d10e6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:11.782868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:11.783543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.783828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.784102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] PATH_INFO: `/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.786044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] RBAC: Authorizing `identity:get_user(user_id=3a547ecd2bf446a2aa047f5f9c68c5a5)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:11.788418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:11.793845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 63/137] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:11 2022] GET /identity/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5 => generated 247 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:11.798504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:11.850915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:11.905875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666af6-a152-4569-b35d-96fab29d10e6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:11.968015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:11.968807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:11.969156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:11.970730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:11.972002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:11.974444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:11.976902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 75/138] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:11.984024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:11.991431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ffb343-378c-47db-9931-fa34a7e9e48c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:12.059360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:12.060233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:12.060590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:12.060996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:12.062643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:12.064478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:12.066461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 64/139] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:11 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:12.072769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:12.091772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:12.173598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cefbc8-d385-4387-9826-21b3b241f043 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:12.237351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112db5ef-3469-4c16-8aa7-9a10b73848a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:12.253993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112db5ef-3469-4c16-8aa7-9a10b73848a0 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:12.253993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112db5ef-3469-4c16-8aa7-9a10b73848a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:12.253993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112db5ef-3469-4c16-8aa7-9a10b73848a0 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:12.253993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112db5ef-3469-4c16-8aa7-9a10b73848a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:12.253993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112db5ef-3469-4c16-8aa7-9a10b73848a0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:12.294239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a9de49-b9ec-4e5c-a917-16ca1f999d16 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:12.344865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5522a7d6-5755-4a60-a908-f1e73a2cb2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:12.345610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a7d6-5755-4a60-a908-f1e73a2cb2ff None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:12.345930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a7d6-5755-4a60-a908-f1e73a2cb2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:12.346207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5522a7d6-5755-4a60-a908-f1e73a2cb2ff None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d/users/3a547ecd2bf446a2aa047f5f9c68c5a5/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:12.351056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522a7d6-5755-4a60-a908-f1e73a2cb2ff None admin] RBAC: Authorizing `identity:create_grant(project_id=95fac151c01642568d306e172fe51b4d, user_id=3a547ecd2bf446a2aa047f5f9c68c5a5, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:12.352568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5522a7d6-5755-4a60-a908-f1e73a2cb2ff None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:12.361747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 76/140] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:11 2022] POST /identity/v3/users => generated 283 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:12.366107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:12.476677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 65/141] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:12 2022] PUT /identity/v3/projects/95fac151c01642568d306e172fe51b4d/users/3a547ecd2bf446a2aa047f5f9c68c5a5/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:13.288732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345df6e-d06a-49ba-8d01-f8adaf12b508 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.289633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345df6e-d06a-49ba-8d01-f8adaf12b508 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.290113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345df6e-d06a-49ba-8d01-f8adaf12b508 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.291664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 77/142] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:13.297538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36177d81-4393-48cc-96d9-c9edde9ee1f9 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.298195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36177d81-4393-48cc-96d9-c9edde9ee1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.298662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36177d81-4393-48cc-96d9-c9edde9ee1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.319907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-36177d81-4393-48cc-96d9-c9edde9ee1f9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:13.321502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-36177d81-4393-48cc-96d9-c9edde9ee1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:13.396435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:13.405530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 66/143] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:13.447158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345df6e-d06a-49ba-8d01-f8adaf12b508 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:13.564873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345df6e-d06a-49ba-8d01-f8adaf12b508 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:13.610556 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:13.611510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.611979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.612428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.628386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:13.634231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:13.635109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:13.635884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:13.637809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 78/144] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:13.643763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36177d81-4393-48cc-96d9-c9edde9ee1f9 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:13.758450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36177d81-4393-48cc-96d9-c9edde9ee1f9 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:13.796081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91cde25-67bf-4f80-befb-72a36446224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:13.796955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cde25-67bf-4f80-befb-72a36446224b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.797403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cde25-67bf-4f80-befb-72a36446224b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.797844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91cde25-67bf-4f80-befb-72a36446224b None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.798713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cde25-67bf-4f80-befb-72a36446224b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:13.799160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cde25-67bf-4f80-befb-72a36446224b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:13.800718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91cde25-67bf-4f80-befb-72a36446224b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:13.810078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 67/145] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:13.818323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:13.820800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c82faf-fdff-4c6f-a5ea-bb66672dbd7e None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.821249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c82faf-fdff-4c6f-a5ea-bb66672dbd7e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.821666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c82faf-fdff-4c6f-a5ea-bb66672dbd7e None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.823193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 68/146] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:13.834266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689176-465b-4a1e-9a14-64cf2e985093 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:13.834755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689176-465b-4a1e-9a14-64cf2e985093 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:13.835261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6689176-465b-4a1e-9a14-64cf2e985093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:13.874849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c6689176-465b-4a1e-9a14-64cf2e985093 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:13.876197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c6689176-465b-4a1e-9a14-64cf2e985093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:13.912907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:13.968472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e00af3-2228-41d1-9e84-4225c5d2e5bd None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:14.006995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:14.012852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:14.013688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.014848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.016726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] PATH_INFO: `/v3/users/9f6328653e72478c9700e681c85b3b8a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.019103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] RBAC: Authorizing `identity:get_user(user_id=9f6328653e72478c9700e681c85b3b8a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:14.021287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:14.025707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 79/147] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:13 2022] GET /identity/v3/users/9f6328653e72478c9700e681c85b3b8a => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:14.031501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 69/148] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:14.033246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:14.127189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689176-465b-4a1e-9a14-64cf2e985093 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:14.227969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb46b42-e73b-4d32-96ef-88eae1e9da9b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:14.269041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6689176-465b-4a1e-9a14-64cf2e985093 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:14.292804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:14.311049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:14.311817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.312001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.312280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.318616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:14.320104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:14.321547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:14.322100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 80/149] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:14 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:14.323065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.323553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.324027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.327551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:14.345683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:14.351660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:14.352507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:14.353275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:14.361788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 70/150] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:14.362990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:14.429645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:14.478975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abd121f-0a6f-4b5e-aa63-a36ac07f7d5a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:14.516272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e1469-ff06-458b-8404-ba4270d17072 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:14.554582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:14.555199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.555484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.555762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d/users/9f6328653e72478c9700e681c85b3b8a/roles/837a0f6aa3e341639e303783696f19e6` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.566550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] RBAC: Authorizing `identity:create_grant(project_id=95fac151c01642568d306e172fe51b4d, user_id=9f6328653e72478c9700e681c85b3b8a, role_id=837a0f6aa3e341639e303783696f19e6)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:14.568544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:14.575911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:14.576546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.576827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.577098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.577842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:14.578145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:14.579535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:14.592406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 71/151] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:14.598320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:14.668033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 81/152] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:14 2022] PUT /identity/v3/projects/95fac151c01642568d306e172fe51b4d/users/9f6328653e72478c9700e681c85b3b8a/roles/837a0f6aa3e341639e303783696f19e6 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:04:14.734172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81900a67-92b4-468c-9d00-76f32d79600d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:14.754136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:14.780163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a8103-e2fe-458e-9c82-462cecb12db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:14.780821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a8103-e2fe-458e-9c82-462cecb12db0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.781105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a8103-e2fe-458e-9c82-462cecb12db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.781380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a8103-e2fe-458e-9c82-462cecb12db0 None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.786527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a8103-e2fe-458e-9c82-462cecb12db0 None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:14.788018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a8103-e2fe-458e-9c82-462cecb12db0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:14.789706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 72/153] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:14 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:14.795516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:14.878648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:14.919048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0ed4-2b34-45a4-a2f1-44b8175962a6 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.919426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0ed4-2b34-45a4-a2f1-44b8175962a6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.919657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4b0ed4-2b34-45a4-a2f1-44b8175962a6 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.921122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 73/154] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:14.927295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7251-1861-44c9-a184-8bcb03d0ecd0 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.927582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7251-1861-44c9-a184-8bcb03d0ecd0 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.927862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7f7251-1861-44c9-a184-8bcb03d0ecd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:14.935999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094f3939-0103-4d89-96cb-93e9e8849078 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:14.970861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4b7f7251-1861-44c9-a184-8bcb03d0ecd0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:14.972091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4b7f7251-1861-44c9-a184-8bcb03d0ecd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:14.979165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:14.980161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:14.980694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:14.981171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:15.093819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:15.096290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:15.191294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 74/155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:15.197784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39aeb-31d7-4035-8bf6-ba4eff38eb5a None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:15.197784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39aeb-31d7-4035-8bf6-ba4eff38eb5a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:15.197784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c39aeb-31d7-4035-8bf6-ba4eff38eb5a None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:15.197784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 75/156] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:15.210203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa4fad-41cc-4458-b1b8-421d926d32cb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:15.210496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa4fad-41cc-4458-b1b8-421d926d32cb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:15.210778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefa4fad-41cc-4458-b1b8-421d926d32cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:15.239545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:15.258802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-cefa4fad-41cc-4458-b1b8-421d926d32cb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:15.260010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cefa4fad-41cc-4458-b1b8-421d926d32cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:15.388813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 82/157] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:15.389818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:15.481324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 76/158] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:15.482065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa4fad-41cc-4458-b1b8-421d926d32cb None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:15.562180 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:15.680604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefa4fad-41cc-4458-b1b8-421d926d32cb None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:15.683049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce0a23-25a6-46a4-867e-64e0975f97f0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:15.761100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:15.761692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:15.762025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:15.762307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:15.777702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:15.777702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:15.777702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:15.777702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:15.778449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:15.780479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:15.791785 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 77/159] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:15 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:15.791785 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:15.810244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:15.827726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:15.828637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:15.829482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:15.833432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 83/160] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 443 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:15.841599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:15.876545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:15.911722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656ebf19-1fa7-4d6f-94c5-201c3a41ef8a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:15.928431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:15.953416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:15.954096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:15.954373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:15.955015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:15.967248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:15.972760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:15.973655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:15.974449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 78/161] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:15.975182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:16.077275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c837e-f3bf-4ad9-b16d-3cf97a37e8f4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:16.079857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40200f2-148d-4002-8820-a2536684a324 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:16.112252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:16.112878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.113144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.113412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.114822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:16.115122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:16.116499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:16.125211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 79/162] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:16.125909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:16.146617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:16.147258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.147543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.147820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.148620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] RBAC: Adding query filter params (role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=34e0b348981c423682cfee52e46660f4) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:16.148928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:16.150458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:16.156952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 84/163] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:15 2022] GET /identity/v3/role_assignments?user.id=34e0b348981c423682cfee52e46660f4&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=2553b3a661e245038eb65b3da25540d8 => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:16.157750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:16.159143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:16.232354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63306e-f8f4-40e8-b3e1-dd07fe1307c6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:16.270272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:16.270997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.271277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.271583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.272306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:16.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:16.274203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:16.283788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 80/164] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:16.290115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:16.317153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:16.341788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11de130-4b57-468d-9831-daaf84044130 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:16.383838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:16.384853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.385132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.385403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.386619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:16.388071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:16.389689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 85/165] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:16 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:16.395820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:16.512418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a30690a-2927-4ab1-bd0c-49c19a1b60df None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:16.553328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:16.554008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.554292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.554563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.574084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:16.589458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:16.612082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b13aa-c84b-403f-9f07-f62a60d11ce0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:16.634268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:16.636210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:16.711026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1233c73-9326-4c43-9504-24da536fafe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:16.711688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233c73-9326-4c43-9504-24da536fafe4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.711970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233c73-9326-4c43-9504-24da536fafe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.712244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1233c73-9326-4c43-9504-24da536fafe4 None admin] PATH_INFO: `/v3/users/34e0b348981c423682cfee52e46660f4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.718484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1233c73-9326-4c43-9504-24da536fafe4 None admin] RBAC: Authorizing `identity:get_user(user_id=34e0b348981c423682cfee52e46660f4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:16.719962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1233c73-9326-4c43-9504-24da536fafe4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:16.721805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 81/166] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:16 2022] GET /identity/v3/users/34e0b348981c423682cfee52e46660f4 => generated 275 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:16.722793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e6f09-7d9f-4ea4-8029-c9d40cecbca4 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.723609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e6f09-7d9f-4ea4-8029-c9d40cecbca4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.723921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9e6f09-7d9f-4ea4-8029-c9d40cecbca4 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.725399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 82/167] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:16.731444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b87-43aa-4af6-9da2-ead7dbb6f73d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.731726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b87-43aa-4af6-9da2-ead7dbb6f73d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.732007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58c1b87-43aa-4af6-9da2-ead7dbb6f73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.742918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 86/168] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:16.743756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:16.773819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e58c1b87-43aa-4af6-9da2-ead7dbb6f73d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:16.775027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e58c1b87-43aa-4af6-9da2-ead7dbb6f73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:16.803059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:16.862761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf587b-bab8-475d-afb5-fd33be9aabb7 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:16.901565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:16.902224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:16.902776 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:16.903052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:16.908168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 83/169] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:16.909110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1b87-43aa-4af6-9da2-ead7dbb6f73d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:16.989357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:16.991292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:17.042244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:17.050482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:17.053954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58c1b87-43aa-4af6-9da2-ead7dbb6f73d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.093494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.094176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.094444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.094713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] PATH_INFO: `/v3/projects/52c0e61899ca43559ec42c52bfba578f` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.096018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] RBAC: Authorizing `identity:get_project(project_id=52c0e61899ca43559ec42c52bfba578f)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:17.097470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:17.105759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 84/170] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:16 2022] GET /identity/v3/projects/52c0e61899ca43559ec42c52bfba578f => generated 312 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:17.105759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:17.120545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 87/171] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:17.121464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:17.245508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c565b16-e6ad-4e8c-9366-6b4173af7a5a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.251387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03721db1-fae7-4d30-af12-1273ddee86bc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.287146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.287788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.288112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.288381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.300838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:17.306470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:17.308591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 85/172] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:17.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:17.335688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:17.346626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.347271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.347555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.347834 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.348665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=52c0e61899ca43559ec42c52bfba578f, user.id=34e0b348981c423682cfee52e46660f4) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:17.348978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:17.350466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:17.368578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 88/173] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:17 2022] GET /identity/v3/role_assignments?user.id=34e0b348981c423682cfee52e46660f4&scope.project.id=52c0e61899ca43559ec42c52bfba578f&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:17.369506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:17.406083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:17.441445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e3f197-f39b-46c7-ab97-d6a9e7646d50 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.480392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280dd464-b640-40e1-80c9-552ef851c085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.481427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd464-b640-40e1-80c9-552ef851c085 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.481906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd464-b640-40e1-80c9-552ef851c085 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.482361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280dd464-b640-40e1-80c9-552ef851c085 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.483760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dd464-b640-40e1-80c9-552ef851c085 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:17.485375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280dd464-b640-40e1-80c9-552ef851c085 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:17.487624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 86/174] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:17 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:17.489090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d469cb-26cb-41aa-b409-88a9f6f3be9c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.489568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d469cb-26cb-41aa-b409-88a9f6f3be9c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.490112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d469cb-26cb-41aa-b409-88a9f6f3be9c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.491666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 87/175] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:17.499419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4e334-fa07-4728-a6ba-4e38b0a01a4d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.500041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4e334-fa07-4728-a6ba-4e38b0a01a4d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.500507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b4e334-fa07-4728-a6ba-4e38b0a01a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.513589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f0da27-5b55-49c8-b8b6-ca92247c6a15 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.531016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-71b4e334-fa07-4728-a6ba-4e38b0a01a4d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:17.532491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-71b4e334-fa07-4728-a6ba-4e38b0a01a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:17.558295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.559308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.559788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.560273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.561216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:17.561718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:17.563347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:17.578145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 89/176] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:17.586737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:17.678197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:17.692406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 88/177] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:17.693283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4e334-fa07-4728-a6ba-4e38b0a01a4d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:17.704289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc29b99d-daab-4345-87d2-7eeccef4617b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.725116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:17.740058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.741043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.741507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.742123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.743230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=34e0b348981c423682cfee52e46660f4) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:17.743749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:17.745485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:17.754479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 90/178] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:17 2022] GET /identity/v3/role_assignments?user.id=34e0b348981c423682cfee52e46660f4&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:17.756030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:17.898680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83866d-f683-4565-aad9-e7f7a9d68fea None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.923422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b4e334-fa07-4728-a6ba-4e38b0a01a4d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:17.973651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.974675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.975155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.975620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.978663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:17.987088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c84a02-b21c-43a7-82ed-fb1be0ce778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:17.987749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84a02-b21c-43a7-82ed-fb1be0ce778e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.996329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84a02-b21c-43a7-82ed-fb1be0ce778e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.996329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c84a02-b21c-43a7-82ed-fb1be0ce778e None admin] PATH_INFO: `/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.996329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c84a02-b21c-43a7-82ed-fb1be0ce778e None admin] RBAC: Authorizing `identity:get_user(user_id=3a547ecd2bf446a2aa047f5f9c68c5a5)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:17.996582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:17.996654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c84a02-b21c-43a7-82ed-fb1be0ce778e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:17.996654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 89/179] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:17 2022] GET /identity/v3/users/3a547ecd2bf446a2aa047f5f9c68c5a5 => generated 247 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:17.996654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693a25-52c8-453c-877f-2c8562f3dae6 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:17.996654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693a25-52c8-453c-877f-2c8562f3dae6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:17.996654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4693a25-52c8-453c-877f-2c8562f3dae6 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:17.996654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 90/180] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:18.002680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c0ef1-13aa-4e22-9cf2-e16af939bd9a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.002680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c0ef1-13aa-4e22-9cf2-e16af939bd9a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.002680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c0ef1-13aa-4e22-9cf2-e16af939bd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:18.005106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:18.006193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:18.007164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:18.010062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 91/181] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:18.014018 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.030890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a11c0ef1-13aa-4e22-9cf2-e16af939bd9a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:18.032575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a11c0ef1-13aa-4e22-9cf2-e16af939bd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:18.122525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 91/182] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:18.123392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c0ef1-13aa-4e22-9cf2-e16af939bd9a None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.143970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.151041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61226d25-5e56-44df-9f94-d6601ae18f68 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.195505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.196141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.196421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.196695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.233156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c0ef1-13aa-4e22-9cf2-e16af939bd9a None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.265286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.268075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be86926-46cf-4420-b626-a065c3911a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.268870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86926-46cf-4420-b626-a065c3911a6c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.269290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86926-46cf-4420-b626-a065c3911a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.269785 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be86926-46cf-4420-b626-a065c3911a6c None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.270516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be86926-46cf-4420-b626-a065c3911a6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:18.270817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be86926-46cf-4420-b626-a065c3911a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.271915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.272189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be86926-46cf-4420-b626-a065c3911a6c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:18.273403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:18.280693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 92/183] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:18.282167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794f0f-6bfd-4833-a56c-533ecbdd455f None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.282448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794f0f-6bfd-4833-a56c-533ecbdd455f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.282719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7794f0f-6bfd-4833-a56c-533ecbdd455f None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.284101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 93/184] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:18.284708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7794f0f-6bfd-4833-a56c-533ecbdd455f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.388357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.411976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7794f0f-6bfd-4833-a56c-533ecbdd455f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.415418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 92/185] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:18.416752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.448494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd8d6-3b5a-4871-ae6f-cc4759d4078c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.449149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd8d6-3b5a-4871-ae6f-cc4759d4078c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.449429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd8d6-3b5a-4871-ae6f-cc4759d4078c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.449701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd8d6-3b5a-4871-ae6f-cc4759d4078c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.461900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd8d6-3b5a-4871-ae6f-cc4759d4078c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-801fd8d6-3b5a-4871-ae6f-cc4759d4078c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:18.468041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:18.468889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:18.470120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 94/186] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:18.475104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6870a-7935-432a-8814-f2f9e918cd8b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.475381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6870a-7935-432a-8814-f2f9e918cd8b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.475662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6870a-7935-432a-8814-f2f9e918cd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.493717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3fe6870a-7935-432a-8814-f2f9e918cd8b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:18.494874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3fe6870a-7935-432a-8814-f2f9e918cd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:18.518933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.524979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b9781a-56db-4401-9a98-f18b2d564765 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.558254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.558929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.559198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.559472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] PATH_INFO: `/v3/users/b04d5f7005544fd9b20476641dfba733` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.562859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 95/187] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:18.563723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6870a-7935-432a-8814-f2f9e918cd8b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.573708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] RBAC: Authorizing `identity:get_user(user_id=b04d5f7005544fd9b20476641dfba733)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.575225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:18.576987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 93/188] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/users/b04d5f7005544fd9b20476641dfba733 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:18.577612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.634527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.666019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6870a-7935-432a-8814-f2f9e918cd8b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.672864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361cb4f-6695-4e28-8f12-7183d2731504 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.700390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7de3a-3b4e-480e-93ad-9bd6daa169b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.701029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7de3a-3b4e-480e-93ad-9bd6daa169b5 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.701317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7de3a-3b4e-480e-93ad-9bd6daa169b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.701581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7de3a-3b4e-480e-93ad-9bd6daa169b5 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.703034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7de3a-3b4e-480e-93ad-9bd6daa169b5 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.704543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7de3a-3b4e-480e-93ad-9bd6daa169b5 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:18.706301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 96/189] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:18.706820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.707435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26513-49e3-4ea5-970f-4006f05d8cda None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.707602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.707746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.707876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26513-49e3-4ea5-970f-4006f05d8cda None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.708037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26513-49e3-4ea5-970f-4006f05d8cda None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.708165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.708724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:18.709028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.709221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 97/190] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:18.710717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:18.713909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26513-49e3-4ea5-970f-4006f05d8cda None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.724133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 94/191] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:18.724133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.740808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.815215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26513-49e3-4ea5-970f-4006f05d8cda None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.821036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62781dab-3532-42f4-8308-507eeecf5273 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.851592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.852211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.852481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.852752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.854771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.855508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.855789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.856064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.856865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.857212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.858687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:18.860513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 95/192] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:18.861056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:18.925278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.927324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:18.943987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:18.959110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904beb9-564e-44c0-b1cf-54065960c12c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:18.994323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42f9d92-da80-4e5a-8da6-2fd1fa255bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:18.994935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9d92-da80-4e5a-8da6-2fd1fa255bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:18.995213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9d92-da80-4e5a-8da6-2fd1fa255bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:18.995481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42f9d92-da80-4e5a-8da6-2fd1fa255bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:18.996275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9d92-da80-4e5a-8da6-2fd1fa255bb9 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=3a547ecd2bf446a2aa047f5f9c68c5a5) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:18.996582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9d92-da80-4e5a-8da6-2fd1fa255bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:18.998054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42f9d92-da80-4e5a-8da6-2fd1fa255bb9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.003656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 96/193] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/role_assignments?user.id=3a547ecd2bf446a2aa047f5f9c68c5a5&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:19.004793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ee6d-5aed-48e5-89ef-1a063847daf7 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.005069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ee6d-5aed-48e5-89ef-1a063847daf7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.005338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d8ee6d-5aed-48e5-89ef-1a063847daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.025549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-25d8ee6d-5aed-48e5-89ef-1a063847daf7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:19.026868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-25d8ee6d-5aed-48e5-89ef-1a063847daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:19.045174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 98/194] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:19.046070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.083763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:19.117669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 97/195] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:19.118861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ee6d-5aed-48e5-89ef-1a063847daf7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.172094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e2cf1-68b4-419e-8038-1be882962a16 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.208980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.209656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.209935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.210206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] PATH_INFO: `/v3/users/b04d5f7005544fd9b20476641dfba733` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.211374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] RBAC: Authorizing `identity:get_user(user_id=b04d5f7005544fd9b20476641dfba733)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:19.212820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.216802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 99/196] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/users/b04d5f7005544fd9b20476641dfba733 => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:19.216802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.220268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:19.240906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d8ee6d-5aed-48e5-89ef-1a063847daf7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.275024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.275645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.275922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.276200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.276978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:19.278482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.315637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ca27e6-7357-4654-9360-46030b8bbefa None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.317905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:19.348977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.349559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.349865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.350140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.351287 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:19.352712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.354409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 100/197] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:19.355244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.378116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 98/198] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:19 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:19.378937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.477991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3ac18c-8fd1-4af1-a3a0-5c0f6ada0c56 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.494097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fbea6a-9a21-426b-8a7d-c669ba128b74 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.524584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.525379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.525666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.525971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.532324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.532929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.533206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.533476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.536741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:19.540212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:19.552164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 101/199] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:19.553148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.587431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:19.619355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:19.620786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.674918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf2dd8d-e47e-400d-b844-62fb180db254 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.716018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.717803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.717803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.717803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.718383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=b04d5f7005544fd9b20476641dfba733) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:19.718700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:19.720152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.727176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 102/200] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/role_assignments?user.id=b04d5f7005544fd9b20476641dfba733&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:19.727987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.752068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 99/201] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:19.758681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.798322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:19.839974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:19.846588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e9f538-cf80-4cfc-aed0-1db95de3e26b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.877302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bee974-f913-4b22-aab2-e105b98ecd47 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:19.884958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.885584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.885890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.886161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.886879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:19.887175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:19.888556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.898529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 103/202] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:19.904045 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:19.917536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:19.918337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:19.918620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:19.918895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:19.920314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:19.922276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:19.924408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 100/203] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:19.931299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:20.024314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb82e1f-2fe9-4718-b994-5ebf4c3aa371 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:20.055806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf22d0f7-2fd4-4db4-8d5b-b92907dc387e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:20.057626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:20.065299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:20.066618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:20.071761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:20.071761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] PATH_INFO: `/v3/users/9f6328653e72478c9700e681c85b3b8a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:20.071761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] RBAC: Authorizing `identity:get_user(user_id=9f6328653e72478c9700e681c85b3b8a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:20.071761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:20.073925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 104/204] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/users/9f6328653e72478c9700e681c85b3b8a => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:20.083292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:20.111839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:20.112705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:20.113038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:20.113312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:20.114887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] RBAC: Adding query filter params (role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=b04d5f7005544fd9b20476641dfba733) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:20.115202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:20.120923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:20.130954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 101/205] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:19 2022] GET /identity/v3/role_assignments?user.id=b04d5f7005544fd9b20476641dfba733&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=2553b3a661e245038eb65b3da25540d8 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:20.143130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:20.252768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a778599d-8cd1-4562-9fc7-bb2ec41e3029 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:20.304461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:20.305104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:20.305391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:20.305665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:20.383765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:20.385149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:20.411764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:20.502693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 105/206] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:20.508538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:20.628757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505873b0-b750-4231-a017-0564bd6bce07 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:20.679484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b94f7-b343-415a-8a86-c76fd1e655ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:20.680045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b94f7-b343-415a-8a86-c76fd1e655ca None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:20.680321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b94f7-b343-415a-8a86-c76fd1e655ca None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:20.680588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b94f7-b343-415a-8a86-c76fd1e655ca None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:20.681785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b94f7-b343-415a-8a86-c76fd1e655ca None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:20.683236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b94f7-b343-415a-8a86-c76fd1e655ca None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:20.684924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 102/207] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:20 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:20.690753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:20.807575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7d850-76b7-4109-b140-a733c929ea75 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:20.840394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:20.843767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da5bcb-b1c3-49a9-8c62-8397f60f373f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:20.844393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da5bcb-b1c3-49a9-8c62-8397f60f373f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:20.844673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da5bcb-b1c3-49a9-8c62-8397f60f373f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:20.844950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da5bcb-b1c3-49a9-8c62-8397f60f373f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:20.845747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da5bcb-b1c3-49a9-8c62-8397f60f373f None admin] RBAC: Adding query filter params (role.id=837a0f6aa3e341639e303783696f19e6, scope.project.id=95fac151c01642568d306e172fe51b4d, user.id=9f6328653e72478c9700e681c85b3b8a) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:20.846084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da5bcb-b1c3-49a9-8c62-8397f60f373f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:20.847532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da5bcb-b1c3-49a9-8c62-8397f60f373f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:20.853954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 106/208] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:20 2022] GET /identity/v3/role_assignments?user.id=9f6328653e72478c9700e681c85b3b8a&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=837a0f6aa3e341639e303783696f19e6 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:21.730870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d08d-65ee-4589-88ef-eab8d50c745e None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:21.731902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d08d-65ee-4589-88ef-eab8d50c745e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:21.732385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57d08d-65ee-4589-88ef-eab8d50c745e None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:21.733983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 103/209] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:21.742902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7ee60-8fc4-4c6d-a4e4-40ffc728ef1e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:21.742902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7ee60-8fc4-4c6d-a4e4-40ffc728ef1e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:21.742902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d7ee60-8fc4-4c6d-a4e4-40ffc728ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:21.760121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e2d7ee60-8fc4-4c6d-a4e4-40ffc728ef1e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:21.761611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e2d7ee60-8fc4-4c6d-a4e4-40ffc728ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:21.829358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 107/210] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:21.853314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d08d-65ee-4589-88ef-eab8d50c745e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:21.891917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:21.965951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57d08d-65ee-4589-88ef-eab8d50c745e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.002177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bebb5-b870-47c1-a4dd-70281042059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.002746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bebb5-b870-47c1-a4dd-70281042059c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.003028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bebb5-b870-47c1-a4dd-70281042059c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.003303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bebb5-b870-47c1-a4dd-70281042059c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.014573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bebb5-b870-47c1-a4dd-70281042059c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-364bebb5-b870-47c1-a4dd-70281042059c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:22.019772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:22.020996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:22.021884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 104/211] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:22.029858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7ee60-8fc4-4c6d-a4e4-40ffc728ef1e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.035939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90150a57-673a-410a-a47a-55081ae08997 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.036228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90150a57-673a-410a-a47a-55081ae08997 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.036505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90150a57-673a-410a-a47a-55081ae08997 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.038164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 105/212] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:22.043036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fcb05-9cb6-47ee-8c7c-dac4e5fa569e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.043324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fcb05-9cb6-47ee-8c7c-dac4e5fa569e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.043606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904fcb05-9cb6-47ee-8c7c-dac4e5fa569e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.063683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-904fcb05-9cb6-47ee-8c7c-dac4e5fa569e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:22.065092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-904fcb05-9cb6-47ee-8c7c-dac4e5fa569e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:22.144386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d7ee60-8fc4-4c6d-a4e4-40ffc728ef1e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.145834 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 106/213] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:22.161028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fcb05-9cb6-47ee-8c7c-dac4e5fa569e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.167143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:22.183254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.184687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.184687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.184845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.185480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:22.185801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:22.187562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:22.187978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:22.197834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 108/214] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:22.203525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.263957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904fcb05-9cb6-47ee-8c7c-dac4e5fa569e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.300346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.301950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.302377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.302795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.304108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:22.305722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:22.311914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2bfc02-2f80-4cc7-a95a-2ff0993c9d28 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.312350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 107/215] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:22.313305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.346435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf136030-691d-4eaa-bb7b-eeccecfefcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.347081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136030-691d-4eaa-bb7b-eeccecfefcad None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.347362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136030-691d-4eaa-bb7b-eeccecfefcad None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.347662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf136030-691d-4eaa-bb7b-eeccecfefcad None admin] PATH_INFO: `/v3/users/b7811a5bd67943f5a3ee39a528248255` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.363811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136030-691d-4eaa-bb7b-eeccecfefcad None admin] RBAC: Authorizing `identity:get_user(user_id=b7811a5bd67943f5a3ee39a528248255)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:22.365273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf136030-691d-4eaa-bb7b-eeccecfefcad None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:22.366988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 109/216] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/users/b7811a5bd67943f5a3ee39a528248255 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:22.372559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef3ee-7202-4504-ae9c-372c3a480d8d None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.372848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef3ee-7202-4504-ae9c-372c3a480d8d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.373122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fef3ee-7202-4504-ae9c-372c3a480d8d None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.374582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 110/217] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:22.375438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef3ee-7202-4504-ae9c-372c3a480d8d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.424451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:22.425459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:22.435435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4548968b-6712-4b44-b354-169b7bf975c5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.468677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4330634-fc29-417e-a9f9-df45ea695fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.469290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330634-fc29-417e-a9f9-df45ea695fff None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.469569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330634-fc29-417e-a9f9-df45ea695fff None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.469872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4330634-fc29-417e-a9f9-df45ea695fff None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.470545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4330634-fc29-417e-a9f9-df45ea695fff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:22.471982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4330634-fc29-417e-a9f9-df45ea695fff None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:22.483465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fef3ee-7202-4504-ae9c-372c3a480d8d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.517158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.517706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.518012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.518317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.577922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 108/218] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:22 2022] POST /identity/v3/users => generated 297 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:22.579205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc821-1e89-4593-81a8-a5157ef29ad0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.579540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc821-1e89-4593-81a8-a5157ef29ad0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.580070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbdc821-1e89-4593-81a8-a5157ef29ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.589125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:22.592892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:22.599620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6fbdc821-1e89-4593-81a8-a5157ef29ad0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:22.600847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6fbdc821-1e89-4593-81a8-a5157ef29ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:22.642172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:22.678660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 109/219] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:22.678660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83375d-af06-404d-ab09-98b6ce7f64c6 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.678660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83375d-af06-404d-ab09-98b6ce7f64c6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.678660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83375d-af06-404d-ab09-98b6ce7f64c6 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.678660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 110/220] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:22.681250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ace2f-77aa-464e-9712-969c7a0cb869 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.681250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ace2f-77aa-464e-9712-969c7a0cb869 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.681250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ace2f-77aa-464e-9712-969c7a0cb869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.700819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-2a4ace2f-77aa-464e-9712-969c7a0cb869 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:22.702180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2a4ace2f-77aa-464e-9712-969c7a0cb869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:22.725450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 111/221] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:22.726436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.786178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 111/222] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:22.794662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ace2f-77aa-464e-9712-969c7a0cb869 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.806168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:22.857592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9da6a-a5df-42d9-a0a5-32f3375844e8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.901280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.901982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.902372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.902654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.912160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:22.915478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:22.919672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ace2f-77aa-464e-9712-969c7a0cb869 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:22.920952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:22.924850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 112/223] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:22.925653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:22.966737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:22.968248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:22.968747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:22.969221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:22.971098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:22.973483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:22.976337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 112/224] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:22.977530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.032655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a20b1b-f212-4cb3-9a12-3ed76b7cab44 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.071323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.071991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.072274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.072547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.085531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:23.091235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:23.092856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 113/225] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:23.094426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.104182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:23.137637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef93152-9793-43c2-8342-c0fc8c8accd5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.171363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:23.184766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.185531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.185949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.186324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.187143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:23.187547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.189053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.201823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 113/226] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:23.202862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.218827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e2fe1-46fe-413d-882a-e252f46af5f4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.258675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.259641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.259924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.260198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.260992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=b7811a5bd67943f5a3ee39a528248255) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:23.261300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.263141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.270351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 114/227] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:23 2022] GET /identity/v3/role_assignments?user.id=b7811a5bd67943f5a3ee39a528248255&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:23.271193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.325068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2544822f-a6df-4b8a-b34b-ab9fe7231e89 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.384654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cdd9d7-3b66-408e-ac5d-6f515a62ff61 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.386526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.387180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.387460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.387730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.388464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:23.388764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.390260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.399666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 114/228] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:23.400234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:23.409745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.417678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:23.430653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.431418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.431763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.432106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] PATH_INFO: `/v3/users/b04d5f7005544fd9b20476641dfba733` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.433903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] RBAC: Authorizing `identity:get_user(user_id=b04d5f7005544fd9b20476641dfba733)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.435454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.437250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 115/229] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:23 2022] GET /identity/v3/users/b04d5f7005544fd9b20476641dfba733 => generated 283 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:23.443067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.589305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8cbe9-5e8c-4b1e-994c-79602cabe10c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.627294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.627957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.628234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.628506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] PATH_INFO: `/v3/users/b04d5f7005544fd9b20476641dfba733` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.629730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] RBAC: Authorizing `identity:get_user(user_id=b04d5f7005544fd9b20476641dfba733)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.631491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.633406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 115/230] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:23 2022] GET /identity/v3/users/b04d5f7005544fd9b20476641dfba733 => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:23.639019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.662211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f701eb9-63ab-440f-ac0a-f77e447b3549 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.714191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:23.747700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3a8a-3867-446c-a06a-098fa460c8b2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.784965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.785834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.786200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.786625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.786721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.786793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.786984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.787086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.788054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.789515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.790271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.791240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 116/231] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:23 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:23.791712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.793396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 116/232] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:23 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:23.796749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.799463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:23.905541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc654ce-6231-4a47-87df-6c82501eeb21 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:23.944567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163d9ff9-ccd8-4848-b0fa-0824465250d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:23.945253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d9ff9-ccd8-4848-b0fa-0824465250d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:23.945539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d9ff9-ccd8-4848-b0fa-0824465250d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:23.945836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d9ff9-ccd8-4848-b0fa-0824465250d2 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df/users/b04d5f7005544fd9b20476641dfba733/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:23.948170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d9ff9-ccd8-4848-b0fa-0824465250d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e62fb4de31482c912819b934f409df, user_id=b04d5f7005544fd9b20476641dfba733, role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:23.949624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163d9ff9-ccd8-4848-b0fa-0824465250d2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:23.953649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:23.970676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:24.013976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c574fde-44e1-48ca-a013-7749357c3711 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:24.047431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 117/233] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:23 2022] PUT /identity/v3/projects/71e62fb4de31482c912819b934f409df/users/b04d5f7005544fd9b20476641dfba733/roles/2553b3a661e245038eb65b3da25540d8 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:04:24.058608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf3296-31d5-4fd4-88e1-153754c5d183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:24.059294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3296-31d5-4fd4-88e1-153754c5d183 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:24.059577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3296-31d5-4fd4-88e1-153754c5d183 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:24.059846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf3296-31d5-4fd4-88e1-153754c5d183 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df/users/b04d5f7005544fd9b20476641dfba733/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:24.061953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3296-31d5-4fd4-88e1-153754c5d183 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e62fb4de31482c912819b934f409df, user_id=b04d5f7005544fd9b20476641dfba733, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:24.063408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf3296-31d5-4fd4-88e1-153754c5d183 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:24.151487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 117/234] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:23 2022] PUT /identity/v3/projects/71e62fb4de31482c912819b934f409df/users/b04d5f7005544fd9b20476641dfba733/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:24.846650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c6c4b-6f76-4787-979b-5bc489bc5f77 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:24.847158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c6c4b-6f76-4787-979b-5bc489bc5f77 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:24.847233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c6c4b-6f76-4787-979b-5bc489bc5f77 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:24.848646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 118/235] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:24.854253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf104-73c6-483d-a6ab-eb4998bca85e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:24.854821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf104-73c6-483d-a6ab-eb4998bca85e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:24.855295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4bf104-73c6-483d-a6ab-eb4998bca85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:24.873888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8d4bf104-73c6-483d-a6ab-eb4998bca85e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:24.875408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8d4bf104-73c6-483d-a6ab-eb4998bca85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:24.963254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 118/236] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:25.009392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c6c4b-6f76-4787-979b-5bc489bc5f77 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:25.157735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c6c4b-6f76-4787-979b-5bc489bc5f77 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:25.203079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd325-0fc8-4d31-9792-67f3cfa50224 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.203587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:25.204108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.204384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.204652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.204877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd325-0fc8-4d31-9792-67f3cfa50224 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.205341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5fd325-0fc8-4d31-9792-67f3cfa50224 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.206977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 119/237] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:25.212713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9bb7b-5aab-4219-b1b9-5d3a24b427e9 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.213232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9bb7b-5aab-4219-b1b9-5d3a24b427e9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.213701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9bb7b-5aab-4219-b1b9-5d3a24b427e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.222993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:25.227894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:25.228763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:25.229550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 119/238] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:25.235052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:25.237014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c3f9bb7b-5aab-4219-b1b9-5d3a24b427e9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:25.239236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c3f9bb7b-5aab-4219-b1b9-5d3a24b427e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:25.310103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:25.340388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:25.345305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 120/239] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:25.376054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9bb7b-5aab-4219-b1b9-5d3a24b427e9 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:25.416620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1481b8b-2b60-405b-984c-04ff660ce186 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:25.454075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:25.454971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.455393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.456212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.457598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:25.458078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:25.459595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:25.469119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 120/240] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:25.476062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:25.537179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9bb7b-5aab-4219-b1b9-5d3a24b427e9 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:25.581060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:25.582237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.582695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.582977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.586549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:25.588020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:25.589891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 121/241] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:25.596570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:25.639628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acd5de-e5e6-4cd5-899d-67f3ee86febb None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:25.668655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:25.678135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:25.688978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86d5a0-a025-4f19-8f39-ed34324a4626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:25.690076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d5a0-a025-4f19-8f39-ed34324a4626 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.690369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d5a0-a025-4f19-8f39-ed34324a4626 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.690654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86d5a0-a025-4f19-8f39-ed34324a4626 None admin] PATH_INFO: `/v3/users/50c11d97553e47239e99078be6fa1d9f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.708699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86d5a0-a025-4f19-8f39-ed34324a4626 None admin] RBAC: Authorizing `identity:get_user(user_id=50c11d97553e47239e99078be6fa1d9f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:25.710809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86d5a0-a025-4f19-8f39-ed34324a4626 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:25.712526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 121/242] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:25 2022] GET /identity/v3/users/50c11d97553e47239e99078be6fa1d9f => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:25.717986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179882-23e5-4516-8f86-257489f94106 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.718488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179882-23e5-4516-8f86-257489f94106 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.718960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79179882-23e5-4516-8f86-257489f94106 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.720459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 122/243] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:25.721924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179882-23e5-4516-8f86-257489f94106 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:25.741404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c55dc76-9ecf-4c9e-a905-065199eba928 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:25.789229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a215b3e-70be-47a6-9bfc-b6de8acb4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:25.790317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215b3e-70be-47a6-9bfc-b6de8acb4c65 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.790790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215b3e-70be-47a6-9bfc-b6de8acb4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.791560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a215b3e-70be-47a6-9bfc-b6de8acb4c65 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.792737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a215b3e-70be-47a6-9bfc-b6de8acb4c65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:25.795044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a215b3e-70be-47a6-9bfc-b6de8acb4c65 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:25.834976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79179882-23e5-4516-8f86-257489f94106 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:25.870074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:25.870745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.870996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.871296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.916701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:25.929522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 122/244] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:25 2022] POST /identity/v3/users => generated 293 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:25.932368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5eee7-7044-4e89-8803-a059dcbf9fb7 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:25.932368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5eee7-7044-4e89-8803-a059dcbf9fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:25.932368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d5eee7-7044-4e89-8803-a059dcbf9fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:25.967142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-57d5eee7-7044-4e89-8803-a059dcbf9fb7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:25.969657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-57d5eee7-7044-4e89-8803-a059dcbf9fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:25.976108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:25.976108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:26.096593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 123/245] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:26.124363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5eee7-7044-4e89-8803-a059dcbf9fb7 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.174987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 123/246] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:04:26.177599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:26.182052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.261289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d5eee7-7044-4e89-8803-a059dcbf9fb7 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:26.293609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:26.317470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:26.318855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.319671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.320126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.324857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78448cf-ad53-47c0-b0df-0df3045f6ef5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:26.335310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:26.342964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:26.343862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:26.344650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:26.346907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 124/247] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:26.354077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.375088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:26.376654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.377095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.377470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.379363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:26.380963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:26.383140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 124/248] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:26.389176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.473235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:26.481267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a3bea8-f45e-4175-b07d-31ec69ac97cb None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:26.504219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d8027-7ebd-46f8-b0bd-c2cce2e2d4bf None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:26.520819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:26.521731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.522267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.522717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.523768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:26.524274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:26.525920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:26.536088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 125/249] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:26.542184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.543336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb55ee6-d028-48b7-ae28-a3aac219d7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:26.544048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55ee6-d028-48b7-ae28-a3aac219d7c3 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.544414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55ee6-d028-48b7-ae28-a3aac219d7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.544757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb55ee6-d028-48b7-ae28-a3aac219d7c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.545616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb55ee6-d028-48b7-ae28-a3aac219d7c3 None admin] RBAC: Adding query filter params (role.id=837a0f6aa3e341639e303783696f19e6, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=50c11d97553e47239e99078be6fa1d9f) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:26.546020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb55ee6-d028-48b7-ae28-a3aac219d7c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:26.548196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb55ee6-d028-48b7-ae28-a3aac219d7c3 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:26.554197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 125/250] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/role_assignments?user.id=50c11d97553e47239e99078be6fa1d9f&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=837a0f6aa3e341639e303783696f19e6 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:26.580387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1338-820b-4854-92a3-66ba255e42b0 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.580671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1338-820b-4854-92a3-66ba255e42b0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.581096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba1338-820b-4854-92a3-66ba255e42b0 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.582954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 126/251] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:26.592659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686b5b-6f2a-4ded-bba2-0d4057f985a7 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.593074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686b5b-6f2a-4ded-bba2-0d4057f985a7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.593449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686b5b-6f2a-4ded-bba2-0d4057f985a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.614797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-84686b5b-6f2a-4ded-bba2-0d4057f985a7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:26.616226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-84686b5b-6f2a-4ded-bba2-0d4057f985a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:26.619045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:26.664485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eb9401-8e66-4392-8bb0-51e6a092a754 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:26.699056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 127/252] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:26.706075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e83e7b7-c74c-4485-b0b8-b4e16dbf888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:26.707070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e7b7-c74c-4485-b0b8-b4e16dbf888a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.707496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e7b7-c74c-4485-b0b8-b4e16dbf888a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.707912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e83e7b7-c74c-4485-b0b8-b4e16dbf888a None admin] PATH_INFO: `/v3/users/b7811a5bd67943f5a3ee39a528248255` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.709348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e7b7-c74c-4485-b0b8-b4e16dbf888a None admin] RBAC: Authorizing `identity:get_user(user_id=b7811a5bd67943f5a3ee39a528248255)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:26.711125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e83e7b7-c74c-4485-b0b8-b4e16dbf888a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:26.713000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 126/253] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/users/b7811a5bd67943f5a3ee39a528248255 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:26.719928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686b5b-6f2a-4ded-bba2-0d4057f985a7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.722970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497307bd-325b-48b8-bb69-5fc5f04ecf7c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.723479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497307bd-325b-48b8-bb69-5fc5f04ecf7c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.723905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497307bd-325b-48b8-bb69-5fc5f04ecf7c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.725861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 127/254] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:26.731835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b793b4-45f1-4a69-af40-b5c303dfc2c5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.732339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b793b4-45f1-4a69-af40-b5c303dfc2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.732801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b793b4-45f1-4a69-af40-b5c303dfc2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.754748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-18b793b4-45f1-4a69-af40-b5c303dfc2c5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:26.756337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-18b793b4-45f1-4a69-af40-b5c303dfc2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:26.786168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:26.837504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686b5b-6f2a-4ded-bba2-0d4057f985a7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:26.841405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 128/255] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:26.845799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b793b4-45f1-4a69-af40-b5c303dfc2c5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.908037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:26.909300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:26.909720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:26.910191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:26.913229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:26.914852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:26.916734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 128/256] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:26.919719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:26.933596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:27.020836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b793b4-45f1-4a69-af40-b5c303dfc2c5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.082835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b98500-d97a-4826-b79a-02a41e779847 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.104280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.104961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.105275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.105554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.124049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:27.129625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:27.130538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:27.131322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 129/257] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:27.131965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:27.167015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.167670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.167860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:27.167957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.168210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.191404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:27.197227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:27.198119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:27.198916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 129/258] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:27.199543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:27.270444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:27.307958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d2de72-88c8-4e2c-8d39-993a3dd43e6a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.325098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498964a-98b2-41de-ab3c-bdc3abb66ca5 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.342808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.343454 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.344104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.344484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.345345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:27.345884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:27.348354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:27.357576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 130/259] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:27.358592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:27.446465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.447157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.447444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.447727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df/users/b7811a5bd67943f5a3ee39a528248255/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.454517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e62fb4de31482c912819b934f409df, user_id=b7811a5bd67943f5a3ee39a528248255, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:27.455996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:27.467812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed9989-8622-436e-a54f-0f895cefb661 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.502126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:27.510013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.510895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.511308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.511758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.512655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:27.513142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:27.514803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:27.524356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 131/260] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:27.525421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:27.568652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 130/261] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:27 2022] PUT /identity/v3/projects/71e62fb4de31482c912819b934f409df/users/b7811a5bd67943f5a3ee39a528248255/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:27.569578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:27.640705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a8f689-278c-4393-94c2-f379334de50e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.683816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.683816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.683816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.683816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] PATH_INFO: `/v3/users/b04d5f7005544fd9b20476641dfba733` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.684257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] RBAC: Authorizing `identity:get_user(user_id=b04d5f7005544fd9b20476641dfba733)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:27.684257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:27.684257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 132/262] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:27 2022] GET /identity/v3/users/b04d5f7005544fd9b20476641dfba733 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:27.690334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:27.724682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:27.758133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:27.767765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9cead-7ac7-49c1-bbd9-079b7ba66872 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.840835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70af6b4-dce3-4d78-909b-fb2cffd316bb None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:27.867027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.867684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.867960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.868229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] PATH_INFO: `/v3/users/b04d5f7005544fd9b20476641dfba733` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.874548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] RBAC: Authorizing `identity:get_user(user_id=b04d5f7005544fd9b20476641dfba733)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:27.876037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:27.877715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 131/263] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:27 2022] GET /identity/v3/users/b04d5f7005544fd9b20476641dfba733 => generated 283 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:27.888035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:27.888674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:27.888956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:27.889232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:27.896369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:27.970811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:27.973536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:28.039151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:28.053407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6c120b-0b34-4158-97b3-f8f00e6eaef3 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:28.094289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:28.095295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:28.095836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:28.096303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:28.115202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:28.129152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 133/264] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:04:28.134771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:28.177719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:28.179539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:28.325635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb2e4a3-b6df-4ac8-ac63-869481cf0e6f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:28.337825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 132/265] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:04:28.345864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:28.373120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:28.374156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:28.374639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:28.375111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:28.376600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:28.378455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:28.381024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 134/266] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:28 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:28.387048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:28.422352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:28.434129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:28.506087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37fdb2d-0fa0-4cae-95a5-13cf75f55d70 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:28.545868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:28.546812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:28.547265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:28.547708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:28.548657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] RBAC: Adding query filter params (role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=b04d5f7005544fd9b20476641dfba733) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:28.549151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:28.551089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:28.558664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 135/267] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:28 2022] GET /identity/v3/role_assignments?user.id=b04d5f7005544fd9b20476641dfba733&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=2553b3a661e245038eb65b3da25540d8 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:28.575265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefce70b-52c8-4735-a908-ca7e2b3399da None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:28.616220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ddaf9-47f8-4871-989d-c413fd6965dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:28.616797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ddaf9-47f8-4871-989d-c413fd6965dd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:28.617075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ddaf9-47f8-4871-989d-c413fd6965dd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:28.617349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ddaf9-47f8-4871-989d-c413fd6965dd None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:28.622263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ddaf9-47f8-4871-989d-c413fd6965dd None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:28.623828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ddaf9-47f8-4871-989d-c413fd6965dd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:28.625658 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 133/268] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:28 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:28.632091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:28.766119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:28.779485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ba92a-f8e5-4bbb-8b50-9470a23c70d4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:28.827113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33bd89-be51-418c-ab62-43e9d23159d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:28.828088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33bd89-be51-418c-ab62-43e9d23159d2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:28.828546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33bd89-be51-418c-ab62-43e9d23159d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:28.829005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33bd89-be51-418c-ab62-43e9d23159d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:28.829996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33bd89-be51-418c-ab62-43e9d23159d2 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=b04d5f7005544fd9b20476641dfba733) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:28.830506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33bd89-be51-418c-ab62-43e9d23159d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:28.832215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db33bd89-be51-418c-ab62-43e9d23159d2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:28.839102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 136/269] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:28 2022] GET /identity/v3/role_assignments?user.id=b04d5f7005544fd9b20476641dfba733&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:29.134728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58b79e-3492-4bd9-85c5-9f3dde305f14 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.135344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58b79e-3492-4bd9-85c5-9f3dde305f14 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.135837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58b79e-3492-4bd9-85c5-9f3dde305f14 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.137422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 134/270] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:29.142816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02047ea-f90e-4ffd-ba42-1bb07506908b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.143251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02047ea-f90e-4ffd-ba42-1bb07506908b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.143417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02047ea-f90e-4ffd-ba42-1bb07506908b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.170760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b02047ea-f90e-4ffd-ba42-1bb07506908b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:29.172021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b02047ea-f90e-4ffd-ba42-1bb07506908b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:29.256486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 137/271] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:29.273525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582a7b-07ef-4753-831f-0961bcad05e2 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.274150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582a7b-07ef-4753-831f-0961bcad05e2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.279839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19582a7b-07ef-4753-831f-0961bcad05e2 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.279839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 135/272] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:29.283154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1095-be9e-42a1-826d-c88961df5205 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.283441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1095-be9e-42a1-826d-c88961df5205 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.283718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ed1095-be9e-42a1-826d-c88961df5205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.283919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19582a7b-07ef-4753-831f-0961bcad05e2 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:29.313436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-71ed1095-be9e-42a1-826d-c88961df5205 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:29.314687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-71ed1095-be9e-42a1-826d-c88961df5205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:29.405923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 138/273] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:29.421166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19582a7b-07ef-4753-831f-0961bcad05e2 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:29.429512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1095-be9e-42a1-826d-c88961df5205 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:29.434387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:29.448187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:29.468680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:29.469745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.470225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.471428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.485542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:29.492040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:29.493125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:29.494154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:29.501881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 136/274] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:29.504323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:29.554643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ed1095-be9e-42a1-826d-c88961df5205 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:29.595730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e571df2-da50-47d9-a890-5c69494165a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:29.596272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571df2-da50-47d9-a890-5c69494165a8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.596548 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571df2-da50-47d9-a890-5c69494165a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.596823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e571df2-da50-47d9-a890-5c69494165a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.607236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e571df2-da50-47d9-a890-5c69494165a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-7e571df2-da50-47d9-a890-5c69494165a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:29.612163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:29.613062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 139/275] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:29.618509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052b699-25a7-4b9c-abc9-bc652682daf4 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.619225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052b699-25a7-4b9c-abc9-bc652682daf4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.619225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b052b699-25a7-4b9c-abc9-bc652682daf4 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.619225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 140/276] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:29.621368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d987-7696-4f44-8667-a93c7a04495e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.621657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d987-7696-4f44-8667-a93c7a04495e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.621957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06d987-7696-4f44-8667-a93c7a04495e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.637348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265cf799-39b7-43fe-80a8-b0505fde2c2e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:29.640227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7c06d987-7696-4f44-8667-a93c7a04495e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:29.641192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7c06d987-7696-4f44-8667-a93c7a04495e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:29.672003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:29.672553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.672838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.673111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.673860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:29.674169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:29.676097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:29.684508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 137/277] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:29.684508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:29.717507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 141/278] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:29.722262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:29.722735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06d987-7696-4f44-8667-a93c7a04495e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:29.732708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:29.803584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789b2f0-3bfa-4aba-94ba-f2d8c8acf0d7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:29.834433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06d987-7696-4f44-8667-a93c7a04495e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:29.838720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:29.839343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.839621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.839892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.840626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:29.840910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:29.842329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:29.850695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 138/279] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:29.850695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:29.876488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:29.877441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.877720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.878026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] PATH_INFO: `/v3/users/fa32adbbdb0a44a8900b6feae82d627e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.894479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] RBAC: Authorizing `identity:get_user(user_id=fa32adbbdb0a44a8900b6feae82d627e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:29.895953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:29.902244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 142/280] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:29 2022] GET /identity/v3/users/fa32adbbdb0a44a8900b6feae82d627e => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:29.902244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:29.952919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:29.960168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172ba916-3db2-42e1-a60a-ea000507beb8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:29.970446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:29.993892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:29.994859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:29.995341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:29.995801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:29.997133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:29.998779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:30.000594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 139/281] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:30.001541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:30.015800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3af2b-e55b-4eb7-b1fd-057950ba3050 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:30.051863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:30.052887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.053152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.053565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] PATH_INFO: `/v3/users/50c11d97553e47239e99078be6fa1d9f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.054760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] RBAC: Authorizing `identity:get_user(user_id=50c11d97553e47239e99078be6fa1d9f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:30.056205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:30.062368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 143/282] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:29 2022] GET /identity/v3/users/50c11d97553e47239e99078be6fa1d9f => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:30.062368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:30.119541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58dc3d7-91f1-4424-8e98-c552fc3aa664 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:30.155472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:30.156089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.156626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.156903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.157687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, user.id=fa32adbbdb0a44a8900b6feae82d627e, scope.system=all) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:30.158025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:30.159465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:30.165540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 140/283] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 18:04:30 2022] GET /identity/v3/role_assignments?user.id=fa32adbbdb0a44a8900b6feae82d627e&scope.system=all&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:30.166469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:30.181174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f9a51-6326-49e0-b92f-4325e4811823 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:30.206584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:30.217345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:30.224057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7581d0e-aa6d-4f54-a445-b229fbce432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:30.224881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581d0e-aa6d-4f54-a445-b229fbce432b None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.225183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581d0e-aa6d-4f54-a445-b229fbce432b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.225524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7581d0e-aa6d-4f54-a445-b229fbce432b None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.226327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7581d0e-aa6d-4f54-a445-b229fbce432b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:30.227864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7581d0e-aa6d-4f54-a445-b229fbce432b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:30.288290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855604b5-ba63-4dc9-b42f-12c038e492f6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:30.324046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475602d-750f-4e0a-a08f-d8a8a4882244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:30.324698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475602d-750f-4e0a-a08f-d8a8a4882244 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.324980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475602d-750f-4e0a-a08f-d8a8a4882244 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.325253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475602d-750f-4e0a-a08f-d8a8a4882244 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.326561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475602d-750f-4e0a-a08f-d8a8a4882244 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:30.328035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475602d-750f-4e0a-a08f-d8a8a4882244 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:30.330119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 141/284] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:30 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:30.331301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802f768-537e-404d-a5d2-766227dc7c5b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.331584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802f768-537e-404d-a5d2-766227dc7c5b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.331855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802f768-537e-404d-a5d2-766227dc7c5b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.333308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 142/285] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:30.335847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802f768-537e-404d-a5d2-766227dc7c5b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:30.387480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 144/286] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:30 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:30.388934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929168-5126-49f2-80d9-d208887f6151 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.389267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929168-5126-49f2-80d9-d208887f6151 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.389597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba929168-5126-49f2-80d9-d208887f6151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.411678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ba929168-5126-49f2-80d9-d208887f6151 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:30.412953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ba929168-5126-49f2-80d9-d208887f6151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:30.471879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:30.483992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802f768-537e-404d-a5d2-766227dc7c5b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:30.494489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 145/287] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:30.521867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929168-5126-49f2-80d9-d208887f6151 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:30.528255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:30.528949 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.529252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.529507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df/users/50c11d97553e47239e99078be6fa1d9f/roles/837a0f6aa3e341639e303783696f19e6` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.536020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e62fb4de31482c912819b934f409df, user_id=50c11d97553e47239e99078be6fa1d9f, role_id=837a0f6aa3e341639e303783696f19e6)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:30.537702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:30.625998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 143/288] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:04:30 2022] PUT /identity/v3/projects/71e62fb4de31482c912819b934f409df/users/50c11d97553e47239e99078be6fa1d9f/roles/837a0f6aa3e341639e303783696f19e6 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:04:30.641797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba929168-5126-49f2-80d9-d208887f6151 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:30.664263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:30.689076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:30.689751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.690055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.690325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.702482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:30.708567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:30.709588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:30.710473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 146/289] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:30.719273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:30.837642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69a2297-8966-489b-984a-88f57eeb2394 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:30.871814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:30.872447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:30.872730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:30.873057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:30.873822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:30.874111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:30.875489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:30.884821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 144/290] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:30.890488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:30.997521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e9d2fa-d993-44ad-962d-0b031e782a0e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:31.035701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:31.036358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:31.036641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:31.036919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] PATH_INFO: `/v3/users/b7811a5bd67943f5a3ee39a528248255` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:31.038135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] RBAC: Authorizing `identity:get_user(user_id=b7811a5bd67943f5a3ee39a528248255)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:31.039585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:31.041417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 147/291] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:30 2022] GET /identity/v3/users/b7811a5bd67943f5a3ee39a528248255 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:31.046718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:31.065537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:31.173601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569890c5-6046-4a26-a611-3449eea16de6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:31.220091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:31.220713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:31.220996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:31.221270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:31.297255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:31.298757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:31.323507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:31.433598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 145/292] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:31.439152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:31.499259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:31.573232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2cb89d-6bd8-4b26-8840-6195b1b3379b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:31.616080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a49b-d1ec-434c-b2c0-0b553cb0e778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:31.616745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a49b-d1ec-434c-b2c0-0b553cb0e778 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:31.617025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a49b-d1ec-434c-b2c0-0b553cb0e778 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:31.617304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a49b-d1ec-434c-b2c0-0b553cb0e778 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:31.618487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a49b-d1ec-434c-b2c0-0b553cb0e778 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:31.619926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a49b-d1ec-434c-b2c0-0b553cb0e778 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:31.621911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 148/293] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:31 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:31.627755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:31.745163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463a9c0-16ad-434b-b860-944133a00bea None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:31.762661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:31.789199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2751d-f716-48ad-8462-883a7fa4b45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:31.789843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2751d-f716-48ad-8462-883a7fa4b45f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:31.790121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2751d-f716-48ad-8462-883a7fa4b45f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:31.790390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2751d-f716-48ad-8462-883a7fa4b45f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:31.791182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2751d-f716-48ad-8462-883a7fa4b45f None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=b7811a5bd67943f5a3ee39a528248255) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:31.791488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2751d-f716-48ad-8462-883a7fa4b45f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:31.793105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2751d-f716-48ad-8462-883a7fa4b45f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:31.799664 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 146/294] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:31 2022] GET /identity/v3/role_assignments?user.id=b7811a5bd67943f5a3ee39a528248255&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:32.418356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee6db2-c138-482e-aed3-43a708ca1188 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:32.418695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee6db2-c138-482e-aed3-43a708ca1188 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:32.418870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dee6db2-c138-482e-aed3-43a708ca1188 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:32.420459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 149/295] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:32.425533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a809e55-4e94-48bd-906e-92320b7d081c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:32.425848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a809e55-4e94-48bd-906e-92320b7d081c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:32.426303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a809e55-4e94-48bd-906e-92320b7d081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:32.447185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0a809e55-4e94-48bd-906e-92320b7d081c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:32.448582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0a809e55-4e94-48bd-906e-92320b7d081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:32.519782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 147/296] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:32.542145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee6db2-c138-482e-aed3-43a708ca1188 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:32.647720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dee6db2-c138-482e-aed3-43a708ca1188 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:32.661748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:32.683738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:32.684308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:32.684588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:32.684857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:32.695861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:32.700877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:32.701840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:32.702656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 150/297] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:32.708608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a809e55-4e94-48bd-906e-92320b7d081c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:32.811975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a809e55-4e94-48bd-906e-92320b7d081c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:32.824050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:32.847726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:32.848351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:32.848619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:32.848892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:32.849601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:32.849934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:32.851315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:32.864702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 148/298] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:32.866213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:32.977074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235eb1-5945-4e60-a279-71a89fcf5391 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.013869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ea1ac-cf65-439b-87f9-f28c7f73a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.014517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea1ac-cf65-439b-87f9-f28c7f73a926 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.014798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea1ac-cf65-439b-87f9-f28c7f73a926 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.015072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ea1ac-cf65-439b-87f9-f28c7f73a926 None admin] PATH_INFO: `/v3/users/fa32adbbdb0a44a8900b6feae82d627e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.016295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ea1ac-cf65-439b-87f9-f28c7f73a926 None admin] RBAC: Authorizing `identity:get_user(user_id=fa32adbbdb0a44a8900b6feae82d627e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.017815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ea1ac-cf65-439b-87f9-f28c7f73a926 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.024132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 151/299] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:32 2022] GET /identity/v3/users/fa32adbbdb0a44a8900b6feae82d627e => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:33.025473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.035332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28423c-6e11-4213-a44e-c8c3292ade1e None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.035612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28423c-6e11-4213-a44e-c8c3292ade1e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.035880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc28423c-6e11-4213-a44e-c8c3292ade1e None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.037219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 152/300] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:33.042036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbc8e0-49ab-46fd-b5a5-aab27e83123e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.042319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbc8e0-49ab-46fd-b5a5-aab27e83123e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.042592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cbc8e0-49ab-46fd-b5a5-aab27e83123e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.061070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c9cbc8e0-49ab-46fd-b5a5-aab27e83123e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:33.062269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c9cbc8e0-49ab-46fd-b5a5-aab27e83123e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:33.095555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.132917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 153/301] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:33.134206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c72f0-d7e5-4df5-945d-6dcf2a313edc None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.134475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c72f0-d7e5-4df5-945d-6dcf2a313edc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.134749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c72f0-d7e5-4df5-945d-6dcf2a313edc None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.136147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 154/302] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:33.144059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7563ca-d634-4118-9740-1afd1de06c47 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.147171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2bd73-1400-4a9f-aa26-49459c4c1ca1 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.147460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2bd73-1400-4a9f-aa26-49459c4c1ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.147736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2bd73-1400-4a9f-aa26-49459c4c1ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.166334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8af2bd73-1400-4a9f-aa26-49459c4c1ca1 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:33.167523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8af2bd73-1400-4a9f-aa26-49459c4c1ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:33.183008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bb1a60-73bf-4a6a-9322-0f826c1fb3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.183678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1a60-73bf-4a6a-9322-0f826c1fb3d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.183961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1a60-73bf-4a6a-9322-0f826c1fb3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.184241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bb1a60-73bf-4a6a-9322-0f826c1fb3d2 None admin] PATH_INFO: `/v3/system/users/fa32adbbdb0a44a8900b6feae82d627e/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.185861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb1a60-73bf-4a6a-9322-0f826c1fb3d2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fa32adbbdb0a44a8900b6feae82d627e, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.187244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bb1a60-73bf-4a6a-9322-0f826c1fb3d2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.234051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 155/303] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:33.235236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc86e-c6e0-4192-8ca1-5006f5cb76be None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.235524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc86e-c6e0-4192-8ca1-5006f5cb76be None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.235804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc86e-c6e0-4192-8ca1-5006f5cb76be None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.237178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 156/304] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:33.237803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc86e-c6e0-4192-8ca1-5006f5cb76be None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.270930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 149/305] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Jul 27 18:04:33 2022] PUT /identity/v3/system/users/fa32adbbdb0a44a8900b6feae82d627e/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:04:33.272215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3a986-66ed-4f63-a305-b3ee16927707 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.272502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3a986-66ed-4f63-a305-b3ee16927707 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.272783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3a986-66ed-4f63-a305-b3ee16927707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.300386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-84e3a986-66ed-4f63-a305-b3ee16927707 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:33.302229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-84e3a986-66ed-4f63-a305-b3ee16927707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:33.341596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.364517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.369877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc86e-c6e0-4192-8ca1-5006f5cb76be None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.394092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 150/306] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:33.394092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3a986-66ed-4f63-a305-b3ee16927707 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.425061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.426399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.426683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.426954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.443742 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:33.448865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:33.450620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 157/307] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:33.451404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.509542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3a986-66ed-4f63-a305-b3ee16927707 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.546365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.547003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.547278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.547541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.555566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9271d-49e8-44b7-85bf-91d6141ace8b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.558813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:33.563766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:33.564871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:33.565900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 151/308] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:33.567323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.595512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.596165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.596433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.596702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.596918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.597970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.599415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.601415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 158/309] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:33.602272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.631570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.677869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c4090-4a75-494e-9133-c4c60987ce87 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.703777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffcb26a-54fe-49db-a83f-602b6f10417e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.714141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.714901 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.715586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.715970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.716697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:33.717007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.718419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.727722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 152/310] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:33.728333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.743583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.744468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.744900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.745181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.745922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:33.746227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.747588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.756822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 159/311] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:33.757609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.830676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.844554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a62d-db10-4e76-81cf-9f2c02d86350 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.855083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:33.864722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd5a265-ba65-4424-8712-5dc6223ca3d2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:33.880738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.881452 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.881855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.882167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] PATH_INFO: `/v3/groups` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.882862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.884713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.904526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:33.905167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:33.905447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:33.905721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] PATH_INFO: `/v3/users/50c11d97553e47239e99078be6fa1d9f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:33.907165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] RBAC: Authorizing `identity:get_user(user_id=50c11d97553e47239e99078be6fa1d9f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:33.908624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:33.910301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 160/312] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/users/50c11d97553e47239e99078be6fa1d9f => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:33.911056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:33.959431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 153/313] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Jul 27 18:04:33 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:33.971845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:34.026011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cf52a-c8d7-4092-833c-e4542711aff0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:34.067767 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:34.068788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:34.069273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:34.069689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] PATH_INFO: `/v3/users/92c4bf975bd64f6bac91d8f4df4eb6ba` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:34.086895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] RBAC: Authorizing `identity:get_user(user_id=92c4bf975bd64f6bac91d8f4df4eb6ba)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:34.088901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:34.090859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 161/314] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/users/92c4bf975bd64f6bac91d8f4df4eb6ba => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:34.096736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:34.113797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7a76fd-1da0-4f32-a324-b5de56f3105b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:34.130879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:34.152778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:34.153408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:34.153884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:34.154008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:34.175156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:34.224564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9285d91f-a17d-42a9-abd6-6270f584f5b1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:34.241824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:34.243576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:34.263998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:34.264723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:34.265286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:34.265625 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:34.266867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] RBAC: Adding query filter params (role.id=837a0f6aa3e341639e303783696f19e6, user.id=92c4bf975bd64f6bac91d8f4df4eb6ba, scope.system=all) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:34.267297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:34.269430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:34.276998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 162/315] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 18:04:34 2022] GET /identity/v3/role_assignments?user.id=92c4bf975bd64f6bac91d8f4df4eb6ba&scope.system=all&role.id=837a0f6aa3e341639e303783696f19e6 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:34.360676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 154/316] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:34.368913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:34.460710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:34.479911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0bedcd-d45c-4cdc-a1b6-fc153308456e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:34.516450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbcbe2b-6a0e-49e9-8351-c9f93ef09c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:34.517096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbe2b-6a0e-49e9-8351-c9f93ef09c5f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:34.517376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbe2b-6a0e-49e9-8351-c9f93ef09c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:34.517644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbcbe2b-6a0e-49e9-8351-c9f93ef09c5f None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:34.518830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcbe2b-6a0e-49e9-8351-c9f93ef09c5f None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:34.520300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbcbe2b-6a0e-49e9-8351-c9f93ef09c5f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:34.525878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 163/317] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:34 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:34.528409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:34.579430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:34.633931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2a8b7-e023-4042-8662-76152a73d83b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:34.667720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5626ba95-9a0c-4453-92c8-61ab2a80d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:34.668336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626ba95-9a0c-4453-92c8-61ab2a80d157 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:34.668610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626ba95-9a0c-4453-92c8-61ab2a80d157 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:34.668876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5626ba95-9a0c-4453-92c8-61ab2a80d157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:34.669661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626ba95-9a0c-4453-92c8-61ab2a80d157 None admin] RBAC: Adding query filter params (role.id=837a0f6aa3e341639e303783696f19e6, scope.project.id=71e62fb4de31482c912819b934f409df, user.id=50c11d97553e47239e99078be6fa1d9f) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:34.669995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626ba95-9a0c-4453-92c8-61ab2a80d157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:34.671409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5626ba95-9a0c-4453-92c8-61ab2a80d157 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:34.677560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 155/318] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:04:34 2022] GET /identity/v3/role_assignments?user.id=50c11d97553e47239e99078be6fa1d9f&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=837a0f6aa3e341639e303783696f19e6 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:35.312208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb00f-d6fa-47f5-88d8-64403bb8a317 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:35.312713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb00f-d6fa-47f5-88d8-64403bb8a317 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:35.312817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dbb00f-d6fa-47f5-88d8-64403bb8a317 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:35.314293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 164/319] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:35.319614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8e11-649e-4d72-9e4a-376899f7f8a3 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:35.319985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8e11-649e-4d72-9e4a-376899f7f8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:35.320160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d8e11-649e-4d72-9e4a-376899f7f8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:35.337845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0c4d8e11-649e-4d72-9e4a-376899f7f8a3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:35.339012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0c4d8e11-649e-4d72-9e4a-376899f7f8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:35.406773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 156/320] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:35.428675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbb00f-d6fa-47f5-88d8-64403bb8a317 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:35.528721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dbb00f-d6fa-47f5-88d8-64403bb8a317 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:35.561947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:35.562581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:35.562856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:35.563123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:35.573728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:35.578672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:35.579533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:35.580322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 165/321] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:35.587385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d8e11-649e-4d72-9e4a-376899f7f8a3 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:35.629593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:35.685504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d8e11-649e-4d72-9e4a-376899f7f8a3 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:35.718621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:35.719237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:35.719512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:35.719778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:35.720484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:35.720782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:35.722249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:35.730477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 157/322] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:35.735711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:35.747560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:35.835597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207b81-8b30-404f-8e8f-bbf8de4c6fd1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:35.868724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8946b0d9-7f4a-48a9-b928-94920e7fa445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:35.869365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946b0d9-7f4a-48a9-b928-94920e7fa445 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:35.869638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946b0d9-7f4a-48a9-b928-94920e7fa445 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:35.869933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8946b0d9-7f4a-48a9-b928-94920e7fa445 None admin] PATH_INFO: `/v3/users/fa32adbbdb0a44a8900b6feae82d627e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:35.871071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946b0d9-7f4a-48a9-b928-94920e7fa445 None admin] RBAC: Authorizing `identity:get_user(user_id=fa32adbbdb0a44a8900b6feae82d627e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:35.872497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8946b0d9-7f4a-48a9-b928-94920e7fa445 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:35.874344 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 166/323] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:35 2022] GET /identity/v3/users/fa32adbbdb0a44a8900b6feae82d627e => generated 293 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:35.880443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:35.980447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d124b-6cc3-4e0f-8e25-93e797d4439f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:35.982809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:36.014038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba5c43-28ad-476a-88ed-a61466c08ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:36.014894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba5c43-28ad-476a-88ed-a61466c08ee2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.015189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba5c43-28ad-476a-88ed-a61466c08ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.015636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba5c43-28ad-476a-88ed-a61466c08ee2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.016702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba5c43-28ad-476a-88ed-a61466c08ee2 None admin] RBAC: Adding query filter params (role.id=7eedc9e13d08457aadc35a07c8edc18c, user.id=fa32adbbdb0a44a8900b6feae82d627e, scope.system=all) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:36.017023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba5c43-28ad-476a-88ed-a61466c08ee2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:36.018488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba5c43-28ad-476a-88ed-a61466c08ee2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:36.032042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 158/324] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 18:04:35 2022] GET /identity/v3/role_assignments?user.id=fa32adbbdb0a44a8900b6feae82d627e&scope.system=all&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 510 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:36.066674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dcb18-d971-444c-874c-359bfa510d59 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.066980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dcb18-d971-444c-874c-359bfa510d59 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.067365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8dcb18-d971-444c-874c-359bfa510d59 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.068944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 167/325] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:36.074702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63938e4-d9c6-41f3-9bfb-2e742492f741 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.074995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63938e4-d9c6-41f3-9bfb-2e742492f741 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.075265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63938e4-d9c6-41f3-9bfb-2e742492f741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.095169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a63938e4-d9c6-41f3-9bfb-2e742492f741 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:36.096390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a63938e4-d9c6-41f3-9bfb-2e742492f741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:36.176634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 159/326] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:36.198631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dcb18-d971-444c-874c-359bfa510d59 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:36.283531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:36.303301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8dcb18-d971-444c-874c-359bfa510d59 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:36.321285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa5a9-d9e9-4f8e-888d-3d72e90e38d6 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.321782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa5a9-d9e9-4f8e-888d-3d72e90e38d6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.321869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fa5a9-d9e9-4f8e-888d-3d72e90e38d6 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.323282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 160/327] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:36.328103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbc723-6bc4-4a34-919a-77edbbc98a2d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.328440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbc723-6bc4-4a34-919a-77edbbc98a2d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.328773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbc723-6bc4-4a34-919a-77edbbc98a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.338000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:36.338735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.339046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.339354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.340650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:36.342398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:36.344218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 168/328] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:36.346841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5ecbc723-6bc4-4a34-919a-77edbbc98a2d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:36.348170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5ecbc723-6bc4-4a34-919a-77edbbc98a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:36.349836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:36.415325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 161/329] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:36.436805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbc723-6bc4-4a34-919a-77edbbc98a2d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:36.447232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3741a7ef-57b5-4bab-8cf5-64db3f4fa03c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:36.459915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:36.479512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:36.480155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.480436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.480708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] PATH_INFO: `/v3/groups` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.481359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:36.482845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:36.533247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbc723-6bc4-4a34-919a-77edbbc98a2d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:36.567633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:36.568202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.568485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.568757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.573078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 169/330] 10.222.0.67 () {60 vars in 1134 bytes} [Wed Jul 27 18:04:36 2022] POST /identity/v3/groups => generated 226 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:36.586035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:36.586972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:36.587999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 162/331] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:36.593402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:36.599504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:36.699605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a05da-7944-4656-9a83-11ce95626a6b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:36.735561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:36.736142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.736420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.748931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.748931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:36.748931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:36.748931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:36.748931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 170/332] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:36.754918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:36.840642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:36.860744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f22c67c-b082-4a0e-828e-88994f4e0b4c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:36.898177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619faa0a-981b-407d-be22-1afb744306b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:36.898830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619faa0a-981b-407d-be22-1afb744306b8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:36.899113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619faa0a-981b-407d-be22-1afb744306b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:36.899386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619faa0a-981b-407d-be22-1afb744306b8 None admin] PATH_INFO: `/v3/users/92c4bf975bd64f6bac91d8f4df4eb6ba` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:36.900686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619faa0a-981b-407d-be22-1afb744306b8 None admin] RBAC: Authorizing `identity:get_user(user_id=92c4bf975bd64f6bac91d8f4df4eb6ba)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:36.902243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619faa0a-981b-407d-be22-1afb744306b8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:36.904080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 163/333] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:36 2022] GET /identity/v3/users/92c4bf975bd64f6bac91d8f4df4eb6ba => generated 293 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:36.910296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:36.984582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:37.021212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4657cc-ae40-4999-a398-5c4daee04464 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:37.058788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a22867-6127-40ad-bd26-9a6fedd998ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:37.059493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a22867-6127-40ad-bd26-9a6fedd998ec None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:37.059773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a22867-6127-40ad-bd26-9a6fedd998ec None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:37.060048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a22867-6127-40ad-bd26-9a6fedd998ec None admin] PATH_INFO: `/v3/system/users/92c4bf975bd64f6bac91d8f4df4eb6ba/roles/837a0f6aa3e341639e303783696f19e6` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:37.061595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a22867-6127-40ad-bd26-9a6fedd998ec None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=92c4bf975bd64f6bac91d8f4df4eb6ba, role_id=837a0f6aa3e341639e303783696f19e6)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:37.063020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a22867-6127-40ad-bd26-9a6fedd998ec None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:37.179045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 171/334] 10.222.0.67 () {58 vars in 1334 bytes} [Wed Jul 27 18:04:36 2022] PUT /identity/v3/system/users/92c4bf975bd64f6bac91d8f4df4eb6ba/roles/837a0f6aa3e341639e303783696f19e6 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:38.864373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2888b-aed6-4a41-bd46-d287e41bfd0b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:38.865404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2888b-aed6-4a41-bd46-d287e41bfd0b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:38.865918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa2888b-aed6-4a41-bd46-d287e41bfd0b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:38.867573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 164/335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:38.873233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca4b65-5713-447a-b8b2-82d6d5ab2935 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:38.873675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca4b65-5713-447a-b8b2-82d6d5ab2935 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:38.873815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca4b65-5713-447a-b8b2-82d6d5ab2935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:38.898888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d3ca4b65-5713-447a-b8b2-82d6d5ab2935 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:38.900103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d3ca4b65-5713-447a-b8b2-82d6d5ab2935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:38.983407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 172/336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:39.036151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2888b-aed6-4a41-bd46-d287e41bfd0b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:39.159916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa2888b-aed6-4a41-bd46-d287e41bfd0b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:39.214550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:39.215218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.215500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.215775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.226951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:39.232154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:39.233029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:39.234242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 165/337] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:39.239531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca4b65-5713-447a-b8b2-82d6d5ab2935 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:39.310094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:39.363990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca4b65-5713-447a-b8b2-82d6d5ab2935 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:39.406250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89daae8c-8132-496b-8efc-7b3c44493a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:39.407213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daae8c-8132-496b-8efc-7b3c44493a5f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.407690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daae8c-8132-496b-8efc-7b3c44493a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.408139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89daae8c-8132-496b-8efc-7b3c44493a5f None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.409028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daae8c-8132-496b-8efc-7b3c44493a5f None admin] RBAC: Adding query filter params (name=member) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:39.409540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daae8c-8132-496b-8efc-7b3c44493a5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:39.411174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89daae8c-8132-496b-8efc-7b3c44493a5f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:39.424743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 173/338] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:39.426672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:39.449484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:39.574847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496edacb-39ee-4b39-98a7-ee8f676b5a56 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:39.615217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee4511-41b8-4137-a4fd-f0d0a3261b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:39.615893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee4511-41b8-4137-a4fd-f0d0a3261b0b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.616175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee4511-41b8-4137-a4fd-f0d0a3261b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.616447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee4511-41b8-4137-a4fd-f0d0a3261b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.675664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553805-7ed6-4ea8-9db8-cf661da2001f None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.675952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553805-7ed6-4ea8-9db8-cf661da2001f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.676152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553805-7ed6-4ea8-9db8-cf661da2001f None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.677746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 174/339] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:39.683564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d739b-81e6-47b0-ae4c-7fecee76c0a3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.683850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d739b-81e6-47b0-ae4c-7fecee76c0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.684134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674d739b-81e6-47b0-ae4c-7fecee76c0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.704668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee4511-41b8-4137-a4fd-f0d0a3261b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:39.705672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee4511-41b8-4137-a4fd-f0d0a3261b0b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:39.722617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:39.726818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-674d739b-81e6-47b0-ae4c-7fecee76c0a3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:39.728044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-674d739b-81e6-47b0-ae4c-7fecee76c0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:39.859551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 175/340] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:39.860818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7357f0-8787-4058-899c-b8d142cfe78c None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.861106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7357f0-8787-4058-899c-b8d142cfe78c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.861382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7357f0-8787-4058-899c-b8d142cfe78c None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.863038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 176/341] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:39.864077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73911-9e29-4058-9b29-02d19f17cf35 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.864360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73911-9e29-4058-9b29-02d19f17cf35 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.864635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb73911-9e29-4058-9b29-02d19f17cf35 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.870038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 177/342] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:39.870155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 166/343] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:39.873793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c043841-1e98-463c-9710-79ab9c87870b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.873793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c043841-1e98-463c-9710-79ab9c87870b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.873793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c043841-1e98-463c-9710-79ab9c87870b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.875906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c295-8366-48f5-998b-e6c599131094 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:39.876190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c295-8366-48f5-998b-e6c599131094 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:39.876467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0c295-8366-48f5-998b-e6c599131094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:39.897280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-29b0c295-8366-48f5-998b-e6c599131094 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:39.898826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-29b0c295-8366-48f5-998b-e6c599131094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:39.907649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-3c043841-1e98-463c-9710-79ab9c87870b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:39.908802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3c043841-1e98-463c-9710-79ab9c87870b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:39.981152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:39.992411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 167/344] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:39.993288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0c295-8366-48f5-998b-e6c599131094 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.005594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 178/345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:40.006791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c043841-1e98-463c-9710-79ab9c87870b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.046698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:40.124646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0c295-8366-48f5-998b-e6c599131094 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.152855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c043841-1e98-463c-9710-79ab9c87870b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.168429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.169408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.169927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.170402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.172756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:40.174451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:40.177254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 168/346] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:39 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:40.178277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.197987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.198645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.198925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.199204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.212837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:40.219163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:40.220085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 27 18:04:40.220886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:40.224032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 179/347] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:40.225002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.283298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:40.302786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009af2d-20c5-4491-a30e-528a70fd0b45 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.313909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:40.346638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.347787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.348265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.348767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.355827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30209f7-4ef7-459b-9c72-362561b1d0ea None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.361221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:40.367159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:40.368067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:40.368880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:40.371559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 169/348] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:40.372556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.398042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.399178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.399656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.400147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.412695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:40.418451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:40.419367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:40.420142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:40.422978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 180/349] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:40.424102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.498044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2f04f-8164-4092-9ea5-dba135dadd8c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.542770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.543766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.544339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.552412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:40.554074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:40.556683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 170/350] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:40.557654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.561384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c6b41-b2b7-4519-a660-8ab3fff09350 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.563268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:40.601657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:40.607186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.608071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.608608 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.610119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.611036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:40.611592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:40.613252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:40.622912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 181/351] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:40.630428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.690378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681ecd43-e469-4825-9dae-2f014e59edc9 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.735410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.736127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.736408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.736680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.737420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:40.737792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:40.739870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:40.755952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 171/352] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:40.757318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.761953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11729f2a-0dfb-4e6d-a07a-f279c9ba5d8e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.808306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.808920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.809744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.809744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.810540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] RBAC: Adding query filter params (name=member) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:40.811689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:40.813121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:40.823622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 182/353] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:40.824570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.858165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:40.883955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:40.891509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88bf2e-54a1-48ce-a422-ea4c3bcc8154 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:40.937312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d9b114-5e16-49a0-9f5d-9f3324a299f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:40.937973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b114-5e16-49a0-9f5d-9f3324a299f3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.938334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b114-5e16-49a0-9f5d-9f3324a299f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.938526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d9b114-5e16-49a0-9f5d-9f3324a299f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.939326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9b114-5e16-49a0-9f5d-9f3324a299f3 None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=95fac151c01642568d306e172fe51b4d) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:40.939633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9b114-5e16-49a0-9f5d-9f3324a299f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:40.941130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d9b114-5e16-49a0-9f5d-9f3324a299f3 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:40.951081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 172/354] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:40.952193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b956-7afd-4108-90f0-330fd96cd58b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:40.952474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b956-7afd-4108-90f0-330fd96cd58b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:40.952750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86b956-7afd-4108-90f0-330fd96cd58b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:40.960264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 173/355] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:40.960264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b956-7afd-4108-90f0-330fd96cd58b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:40.973476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc2972b-e31d-4568-98ce-7b2bd8e0bf85 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:41.025891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:41.027546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.028484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.028979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] PATH_INFO: `/v3/users/92c4bf975bd64f6bac91d8f4df4eb6ba` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.031136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=92c4bf975bd64f6bac91d8f4df4eb6ba)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:41.033702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:41.036671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 183/356] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/users/92c4bf975bd64f6bac91d8f4df4eb6ba => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:41.038374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:41.104804 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86b956-7afd-4108-90f0-330fd96cd58b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:41.154599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc94668-e97b-4bf6-b4ee-c40a84ed7489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:41.155243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94668-e97b-4bf6-b4ee-c40a84ed7489 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.155668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94668-e97b-4bf6-b4ee-c40a84ed7489 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.157060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc94668-e97b-4bf6-b4ee-c40a84ed7489 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.161942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:41.171711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd1f1f7-84b7-4115-892c-06bafa058eb8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:41.192207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:41.218677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:41.219610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.219955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.220227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.246614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc94668-e97b-4bf6-b4ee-c40a84ed7489 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:41.248515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc94668-e97b-4bf6-b4ee-c40a84ed7489 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:41.305972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:41.307772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:41.386779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 174/357] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:41.387969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ef07-ad65-422f-bdbe-747c57df7728 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.388253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ef07-ad65-422f-bdbe-747c57df7728 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.388529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac0ef07-ad65-422f-bdbe-747c57df7728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.415401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-bac0ef07-ad65-422f-bdbe-747c57df7728 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:41.416900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-bac0ef07-ad65-422f-bdbe-747c57df7728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:41.426272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:41.437483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 184/358] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:41.438720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:41.485966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:41.505735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 175/359] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:41.507250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534402f8-db7f-4060-81ca-9d93536235b5 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.507547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534402f8-db7f-4060-81ca-9d93536235b5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.507943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534402f8-db7f-4060-81ca-9d93536235b5 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.509787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 176/360] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:41.511057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534402f8-db7f-4060-81ca-9d93536235b5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:41.556039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34709028-7476-4d0f-b91f-6baeeaad6d1e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:41.601341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:41.602007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.603006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.603006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.603722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] RBAC: Adding query filter params (role.id=837a0f6aa3e341639e303783696f19e6, user.id=92c4bf975bd64f6bac91d8f4df4eb6ba, scope.system=all) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:41.603828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:41.605253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:41.621569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 185/361] 10.222.0.67 () {56 vars in 1308 bytes} [Wed Jul 27 18:04:41 2022] GET /identity/v3/role_assignments?user.id=92c4bf975bd64f6bac91d8f4df4eb6ba&scope.system=all&role.id=837a0f6aa3e341639e303783696f19e6 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:41.622792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:41.657831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534402f8-db7f-4060-81ca-9d93536235b5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:41.698228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:41.704509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c33a22f-5af0-4e10-adba-b2c62f582f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:41.711135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33a22f-5af0-4e10-adba-b2c62f582f7b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.711135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33a22f-5af0-4e10-adba-b2c62f582f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.711135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c33a22f-5af0-4e10-adba-b2c62f582f7b None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.711135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33a22f-5af0-4e10-adba-b2c62f582f7b None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:41.711135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c33a22f-5af0-4e10-adba-b2c62f582f7b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:41.712413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 177/362] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:41 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:41.713914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a9ab-58bf-48c3-b088-2e7c1d4f4f21 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.714378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a9ab-58bf-48c3-b088-2e7c1d4f4f21 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.714824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a9ab-58bf-48c3-b088-2e7c1d4f4f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.735578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3b71a9ab-58bf-48c3-b088-2e7c1d4f4f21 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:41.737294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3b71a9ab-58bf-48c3-b088-2e7c1d4f4f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:41.763341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18743598-db6e-431a-bdf7-09bd8c512c05 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:41.804937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:41.817858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:41.818563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:41.818858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:41.819287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:41.821238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:41.823035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:41.825064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 186/363] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:41 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:41.825507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 178/364] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:41.826755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71a9ab-58bf-48c3-b088-2e7c1d4f4f21 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:41.830247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:41.979229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67813865-3e20-4a17-a06c-9cbfafdb6c0f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:41.991727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71a9ab-58bf-48c3-b088-2e7c1d4f4f21 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.002734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:42.023823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.024649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.024931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.025561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.033090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.033750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.034059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.034872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.036301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.037734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:42.038721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:42.039581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 179/365] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:41 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:42.040135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:42.044154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:42.045088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:42.045974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:42.046994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 187/366] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:42.047491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.116548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:42.174355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92161dd-54dc-44de-b68b-5eba7bfa4cee None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.200398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ef9ebe-3852-4f80-9b30-69394609063b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.228437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.229445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.229561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.229753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.230947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.232384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:42.236043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 180/367] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:42.239426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.245597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.246332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.246622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.246901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.262273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:42.268862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:42.269747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:42.270586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 188/368] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:42.271238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.326292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:42.370313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66d0f32-c8ab-4f50-854a-27da374eb161 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.399961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:42.416741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.418001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.418468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.418916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.419445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd26078-bb5a-4df1-ab46-a187d10d2576 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.420091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=95fac151c01642568d306e172fe51b4d) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:42.420574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.423361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:42.430698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 181/369] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=2553b3a661e245038eb65b3da25540d8 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:42.432269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.476518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.477159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.477433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.477701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.478456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:42.478755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.480196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:42.489694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 189/370] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:42.490778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.572932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966144c-015d-466d-97d9-5c8f9c97538d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.615759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.616387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.616662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.616935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.617477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43c1e3-1643-43c1-98dc-2d9d5f89d2fe None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.617730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=71e62fb4de31482c912819b934f409df) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:42.618086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.619204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:42.620942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:42.630858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 182/371] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:42.634312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.673129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.673859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.674100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.674375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.675751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:42.675995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.677560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:42.687435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 190/372] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:42.693410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:42.723554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:42.805298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717e0383-c701-4a81-8516-e303e9ff9a1f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.846484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.847252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.847532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.847799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.849825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9022dbc4-630a-45e8-8770-9242463dc489 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:42.890502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5caa66-7e4e-4e5a-9e97-2a591546db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:42.891149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5caa66-7e4e-4e5a-9e97-2a591546db06 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:42.891431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5caa66-7e4e-4e5a-9e97-2a591546db06 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:42.891706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5caa66-7e4e-4e5a-9e97-2a591546db06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:42.924173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.925916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:42.928724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:42.975736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5caa66-7e4e-4e5a-9e97-2a591546db06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:42.977398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5caa66-7e4e-4e5a-9e97-2a591546db06 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:43.046459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:43.123771 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 183/373] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:43.129918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.217877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 191/374] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:04:43.234020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13088f-c337-4ba2-9170-f382e7d0f6fd None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.234384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13088f-c337-4ba2-9170-f382e7d0f6fd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.234870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13088f-c337-4ba2-9170-f382e7d0f6fd None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.236758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 192/375] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:43.240557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13088f-c337-4ba2-9170-f382e7d0f6fd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.252434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6781eb43-5940-41e8-b14d-a8af11d8ab15 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.290941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcbff73-6f6a-4559-9e80-f6d1c68aaefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:43.291840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbff73-6f6a-4559-9e80-f6d1c68aaefe None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.292352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbff73-6f6a-4559-9e80-f6d1c68aaefe None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.292830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcbff73-6f6a-4559-9e80-f6d1c68aaefe None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.294254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbff73-6f6a-4559-9e80-f6d1c68aaefe None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:43.295927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcbff73-6f6a-4559-9e80-f6d1c68aaefe None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:43.297828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 184/376] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:43.299549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20b5d-305f-4b99-ba0c-c5c4c69b3685 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.299549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20b5d-305f-4b99-ba0c-c5c4c69b3685 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.299549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c20b5d-305f-4b99-ba0c-c5c4c69b3685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.318716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a5c20b5d-305f-4b99-ba0c-c5c4c69b3685 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:43.319895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a5c20b5d-305f-4b99-ba0c-c5c4c69b3685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:43.335058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:43.350860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:43.399888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13088f-c337-4ba2-9170-f382e7d0f6fd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.403603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 185/377] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:43.404461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20b5d-305f-4b99-ba0c-c5c4c69b3685 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.437283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:43.438236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.438511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.438778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] PATH_INFO: `/v3/projects/92b4949330f5444faa0288f0a88fa18a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.439954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] RBAC: Authorizing `identity:get_project(project_id=92b4949330f5444faa0288f0a88fa18a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:43.442117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:43.444081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 193/378] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/projects/92b4949330f5444faa0288f0a88fa18a => generated 344 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:43.454718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.537817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c20b5d-305f-4b99-ba0c-c5c4c69b3685 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.570938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b70116-cf2a-460b-907a-6facb6518a43 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.575495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:43.576151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.576430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.576702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.577906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:43.579353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:43.581375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 186/379] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:43.583296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.603093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:43.613453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:43.616722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:43.622863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.622863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.622863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] PATH_INFO: `/v3/groups/0fd2941d64a0454e91cadf82a6da43f1` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.624247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] RBAC: Authorizing `identity:get_group(group_id=0fd2941d64a0454e91cadf82a6da43f1)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:43.625814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:43.627783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 194/380] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/groups/0fd2941d64a0454e91cadf82a6da43f1 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:43.629117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.696967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9fa13-4948-4506-ad69-54014616db7a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.733053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:43.733704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.734025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.734297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.740860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ec8e6-d3ff-4129-8856-d9141fef06b4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.745928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:43.750879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:43.751788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:43.752565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 187/381] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:43.753780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.777127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:43.777917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.778195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.778567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.779350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=71e62fb4de31482c912819b934f409df) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:43.779654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:43.781421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:43.788076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 195/382] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=2553b3a661e245038eb65b3da25540d8 => generated 260 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:43.788977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:43.846063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:43.900539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f08e79-c212-4c5b-813d-2766f3607efa None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.910149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:43.976319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:43.976964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:43.977238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:43.977506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:43.978344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] RBAC: Adding query filter params (group.id=0fd2941d64a0454e91cadf82a6da43f1, role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=92b4949330f5444faa0288f0a88fa18a) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:43.978651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:43.980136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:43.993070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ffcf41-0966-494d-b9f0-41d31dffd9f8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:43.996436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 188/383] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/role_assignments?group.id=0fd2941d64a0454e91cadf82a6da43f1&scope.project.id=92b4949330f5444faa0288f0a88fa18a&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:44.044233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:44.044880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:44.045160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:44.045433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:44.046212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] RBAC: Adding query filter params (name=member) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:44.046518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:44.047961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:44.058927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 196/384] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:44.064799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:44.175366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c711bca3-a022-4d5a-b31d-e734006b1a5d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:44.211140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:44.211799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:44.212070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:44.212350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:44.213527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:44.215028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:44.216953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 189/385] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:44 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:44.222642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:44.336435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4918f-710a-46f8-be60-b7d275e35512 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:44.360107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:44.372120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c29dee5-ea80-473d-893f-f02d36231b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:44.378420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29dee5-ea80-473d-893f-f02d36231b4b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:44.378420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29dee5-ea80-473d-893f-f02d36231b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:44.378420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c29dee5-ea80-473d-893f-f02d36231b4b None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:44.378420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29dee5-ea80-473d-893f-f02d36231b4b None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:44.378420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c29dee5-ea80-473d-893f-f02d36231b4b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:44.379874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 197/386] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:44 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:44.385658 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:44.398340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:44.492055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4dd62-0e1b-4fa1-9e3a-846ddc60e1e5 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:44.527824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2aad61-3315-45b3-873a-98ece41859cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:44.528505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aad61-3315-45b3-873a-98ece41859cb None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:44.528786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aad61-3315-45b3-873a-98ece41859cb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:44.529061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2aad61-3315-45b3-873a-98ece41859cb None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d/groups/470ff254a328400aa0c02e1fd3f425ce/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:44.531282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2aad61-3315-45b3-873a-98ece41859cb None admin] RBAC: Authorizing `identity:create_grant(project_id=95fac151c01642568d306e172fe51b4d, group_id=470ff254a328400aa0c02e1fd3f425ce, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:44.532713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2aad61-3315-45b3-873a-98ece41859cb None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:44.607005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 190/387] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 18:04:44 2022] PUT /identity/v3/projects/95fac151c01642568d306e172fe51b4d/groups/470ff254a328400aa0c02e1fd3f425ce/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:44.964171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e184-60bd-468a-bd36-4da3c57efdab None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:44.964358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e184-60bd-468a-bd36-4da3c57efdab None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:44.964624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0300e184-60bd-468a-bd36-4da3c57efdab None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:44.966424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 198/388] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:44.971117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3867d-1f27-4f96-a9f9-20db2617030b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:44.971404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3867d-1f27-4f96-a9f9-20db2617030b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:44.972281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3867d-1f27-4f96-a9f9-20db2617030b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:44.995575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-f3e3867d-1f27-4f96-a9f9-20db2617030b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:44.996741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f3e3867d-1f27-4f96-a9f9-20db2617030b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:45.072829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:45.078778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 191/389] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:45.129561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300e184-60bd-468a-bd36-4da3c57efdab None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:45.255439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0300e184-60bd-468a-bd36-4da3c57efdab None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:45.264936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b3d4-e0ed-4a63-9734-ca47ebe20f03 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:45.265269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b3d4-e0ed-4a63-9734-ca47ebe20f03 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:45.265542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c31b3d4-e0ed-4a63-9734-ca47ebe20f03 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:45.266923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 192/390] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:45.272073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1531-eb18-4deb-907a-438671d25ca5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:45.277910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1531-eb18-4deb-907a-438671d25ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:45.277910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b1531-eb18-4deb-907a-438671d25ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:45.301980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:45.302641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:45.303649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:45.303931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:45.305311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3a5b1531-eb18-4deb-907a-438671d25ca5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:45.306536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3a5b1531-eb18-4deb-907a-438671d25ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:45.322353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:45.327294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:45.329299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:45.331310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 199/391] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:45.336756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:45.435960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:45.443270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 193/392] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:45.483549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b1531-eb18-4deb-907a-438671d25ca5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:45.514999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5c9531-119a-4c28-bc5c-67d4b7e53be5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:45.577217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:45.577877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:45.578162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:45.578435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:45.579217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:45.579523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:45.581564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:45.590741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 200/393] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:45.596393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:45.703961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b0caa-af40-4b0a-9a3e-e33a69313be6 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:45.706939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b1531-eb18-4deb-907a-438671d25ca5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:45.717659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:45.740664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:45.741316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:45.741595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:45.741904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:45.743061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:45.744505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:45.746261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 201/394] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:45 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:45.752021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:45.779009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:45.806445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:45.807107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:45.807388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:45.807659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:45.836734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:45.841652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:45.842553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:45.843338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 194/395] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:45.851340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:45.863075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c26fa2-e6da-4756-91e8-aacffc8c58f4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:45.902079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:45.902731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:45.903015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:45.903291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:45.904634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:45.906418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:45.908397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 202/396] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:45 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:45.914115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:45.968480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:46.028593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45855b7e-4053-4726-b3d6-173bd3d49f99 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:46.040139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2f1b6d-5657-4b4e-a704-9886905b104f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:46.075597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:46.076782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.077320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.077803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d/groups/470ff254a328400aa0c02e1fd3f425ce/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.080374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] RBAC: Authorizing `identity:create_grant(project_id=95fac151c01642568d306e172fe51b4d, group_id=470ff254a328400aa0c02e1fd3f425ce, role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:46.082799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:46.093245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:46.094584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.095087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.095549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.096793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:46.097307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:46.104340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:46.121051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 195/397] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:46.129560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:46.178546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 203/398] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 18:04:45 2022] PUT /identity/v3/projects/95fac151c01642568d306e172fe51b4d/groups/470ff254a328400aa0c02e1fd3f425ce/roles/2553b3a661e245038eb65b3da25540d8 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:46.186677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:46.270274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57a27ef-6692-471a-9432-e392947b2b7e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:46.320518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8ad6b0-dd94-40fe-84f1-f601b1d4436b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:46.321097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ad6b0-dd94-40fe-84f1-f601b1d4436b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.321376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ad6b0-dd94-40fe-84f1-f601b1d4436b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.321648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8ad6b0-dd94-40fe-84f1-f601b1d4436b None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.322869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ad6b0-dd94-40fe-84f1-f601b1d4436b None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:46.324314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8ad6b0-dd94-40fe-84f1-f601b1d4436b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:46.326373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 196/399] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:46 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:46.332751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:46.452781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e1212-8505-40b5-8923-044cc1ad7845 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:46.453871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6a09-b958-40d7-9814-61ae8c131c17 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.454163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6a09-b958-40d7-9814-61ae8c131c17 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.454440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65e6a09-b958-40d7-9814-61ae8c131c17 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.455808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 197/400] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:46.461735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009106e-75a5-4e3e-9bae-07a548c8b458 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.462144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009106e-75a5-4e3e-9bae-07a548c8b458 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.462428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7009106e-75a5-4e3e-9bae-07a548c8b458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.467000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:46.488148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7009106e-75a5-4e3e-9bae-07a548c8b458 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:46.489330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7009106e-75a5-4e3e-9bae-07a548c8b458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:46.489551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:46.490280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.490562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.490837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.492008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:46.493443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:46.495470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 204/401] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:46 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:46.501891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:46.590509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 198/402] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:46.591730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c432-19bf-4c94-beeb-2af1c2e59cc6 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.591977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c432-19bf-4c94-beeb-2af1c2e59cc6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.592247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b796c432-19bf-4c94-beeb-2af1c2e59cc6 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.593800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 199/403] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:46.600079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28acd9-0732-4c28-9212-f3f4164be0e5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.600358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28acd9-0732-4c28-9212-f3f4164be0e5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.600881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b28acd9-0732-4c28-9212-f3f4164be0e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.625197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4b28acd9-0732-4c28-9212-f3f4164be0e5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:46.626697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4b28acd9-0732-4c28-9212-f3f4164be0e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:46.648916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f30ca-4c29-458f-9d81-e9a236d873d5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:46.683234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:46.695058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:46.696171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.696460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.696719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df/groups/470ff254a328400aa0c02e1fd3f425ce/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.699137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e62fb4de31482c912819b934f409df, group_id=470ff254a328400aa0c02e1fd3f425ce, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:46.701245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:46.711768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 200/404] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:46.712996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28acd9-0732-4c28-9212-f3f4164be0e5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:46.785114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 205/405] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 18:04:46 2022] PUT /identity/v3/projects/71e62fb4de31482c912819b934f409df/groups/470ff254a328400aa0c02e1fd3f425ce/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:04:46.786051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:46.829595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b28acd9-0732-4c28-9212-f3f4164be0e5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:46.837684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:46.919347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28a2be-f288-4120-b778-b9e5cd424084 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:46.930537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:46.931210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.931486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.931751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.960817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:46.961879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:46.962353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:46.962843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:46.970780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:46.974905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:46.979202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:46.980105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:46.981222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:46.991627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:46.992535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:46.993317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:46.993965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 201/406] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:46.994034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 206/407] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:46.994097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:46.994168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.035240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.097474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4514e87-eb54-4a20-b8eb-4df3ce2db004 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.127073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19107ad6-d2f9-40ff-9765-e6575e12c41f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.130071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.154515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.155147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.155425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.155950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.156667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:47.157033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.158456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.168193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.169048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.169491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.169842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.174479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:47.176333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.178033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.180029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 202/408] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:47.185390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.199026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 207/409] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:47.205305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.328136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.332654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e9d43-0f90-415e-bfa6-d8a6d5c5b95f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.339244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b24e919-38ab-406a-9d12-9737075cd428 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.375964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c6a84-c330-432a-af61-54e1559f95ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.376941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6a84-c330-432a-af61-54e1559f95ef None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.377385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6a84-c330-432a-af61-54e1559f95ef None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.378471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c6a84-c330-432a-af61-54e1559f95ef None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.379799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c6a84-c330-432a-af61-54e1559f95ef None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.381450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077c6a84-c330-432a-af61-54e1559f95ef None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.381795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.382455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.382735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.383007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] PATH_INFO: `/v3/groups/0fd2941d64a0454e91cadf82a6da43f1` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.384243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] RBAC: Authorizing `identity:get_group(group_id=0fd2941d64a0454e91cadf82a6da43f1)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.384681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 203/410] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:47 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:47.385724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.386318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b7c9-8a31-464d-be15-bc76c3ca7edd None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.386786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b7c9-8a31-464d-be15-bc76c3ca7edd None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.387260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034b7c9-8a31-464d-be15-bc76c3ca7edd None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.387600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 208/411] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:47 2022] GET /identity/v3/groups/0fd2941d64a0454e91cadf82a6da43f1 => generated 229 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:47.396786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.397405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 204/412] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:47.398445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034b7c9-8a31-464d-be15-bc76c3ca7edd None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.419793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.496301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f44e15-817c-450a-9f4d-366f981bf039 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.507414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e034b7c9-8a31-464d-be15-bc76c3ca7edd None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.534750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e22509-8b88-4c6a-87d6-cc518dd4cc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.535407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e22509-8b88-4c6a-87d6-cc518dd4cc97 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.535686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e22509-8b88-4c6a-87d6-cc518dd4cc97 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.535958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e22509-8b88-4c6a-87d6-cc518dd4cc97 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.537174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e22509-8b88-4c6a-87d6-cc518dd4cc97 None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.538640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e22509-8b88-4c6a-87d6-cc518dd4cc97 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.540699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 209/413] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:47 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:47.541986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a0127-8183-4db0-8fdb-284cee5d24ce None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.542268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a0127-8183-4db0-8fdb-284cee5d24ce None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.542594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a0127-8183-4db0-8fdb-284cee5d24ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.546635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.547522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.547993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.548471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] PATH_INFO: `/v3/projects/92b4949330f5444faa0288f0a88fa18a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.550389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] RBAC: Authorizing `identity:get_project(project_id=92b4949330f5444faa0288f0a88fa18a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.552002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.558676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 205/414] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:47 2022] GET /identity/v3/projects/92b4949330f5444faa0288f0a88fa18a => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:47.559705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.562434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b85a0127-8183-4db0-8fdb-284cee5d24ce None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:47.563692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b85a0127-8183-4db0-8fdb-284cee5d24ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:47.596697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.635287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 210/415] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:47.635861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a0127-8183-4db0-8fdb-284cee5d24ce None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.661793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.667157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c2f00-25a3-4656-b553-d87212155400 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.705029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.706196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.706667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.707150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df/groups/470ff254a328400aa0c02e1fd3f425ce/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.709848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] RBAC: Authorizing `identity:create_grant(project_id=71e62fb4de31482c912819b934f409df, group_id=470ff254a328400aa0c02e1fd3f425ce, role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.711492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.739592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a0127-8183-4db0-8fdb-284cee5d24ce None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.777163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 206/416] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 18:04:47 2022] PUT /identity/v3/projects/71e62fb4de31482c912819b934f409df/groups/470ff254a328400aa0c02e1fd3f425ce/roles/2553b3a661e245038eb65b3da25540d8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:47.778289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:47.799855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.800950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.801403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.804866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] PATH_INFO: `/v3/projects/92b4949330f5444faa0288f0a88fa18a/groups/0fd2941d64a0454e91cadf82a6da43f1/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.807198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] RBAC: Authorizing `identity:create_grant(project_id=92b4949330f5444faa0288f0a88fa18a, group_id=0fd2941d64a0454e91cadf82a6da43f1, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:47.810236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:47.886860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 211/417] 10.222.0.67 () {58 vars in 1442 bytes} [Wed Jul 27 18:04:47 2022] PUT /identity/v3/projects/92b4949330f5444faa0288f0a88fa18a/groups/0fd2941d64a0454e91cadf82a6da43f1/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:04:47.926958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:47.937741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bbcd4d-e3e3-49bf-bbab-30088f729457 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:47.983787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:47.984440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:47.984717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:47.984984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:47.998831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:48.004889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:48.005873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:48.006891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 207/418] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:48.012136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:48.111540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:48.130597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db54ec51-4167-4e06-93db-9d708c041a7b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:48.169180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348fcc1-f469-430a-a32c-fc532a64dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:48.169832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348fcc1-f469-430a-a32c-fc532a64dda0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:48.170114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348fcc1-f469-430a-a32c-fc532a64dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:48.170482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348fcc1-f469-430a-a32c-fc532a64dda0 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:48.171202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348fcc1-f469-430a-a32c-fc532a64dda0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:48.171502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348fcc1-f469-430a-a32c-fc532a64dda0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:48.173002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0348fcc1-f469-430a-a32c-fc532a64dda0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:48.183932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 212/419] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:48.190968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:48.301603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a6a58-5f9c-427e-a00d-4bdd3fa87f56 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:48.337459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:48.338164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:48.338453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:48.338727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:48.378911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:48.437168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:48.438659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:48.536723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079eeddc-72d5-43e8-bfae-96978720fc71 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:48.537361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079eeddc-72d5-43e8-bfae-96978720fc71 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:48.537361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079eeddc-72d5-43e8-bfae-96978720fc71 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:48.538752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 213/420] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:48.555430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0142db-978e-4bb4-834d-18b47e90b7be None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:48.555693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0142db-978e-4bb4-834d-18b47e90b7be None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:48.555885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0142db-978e-4bb4-834d-18b47e90b7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:48.580062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 208/421] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:48.581646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bd0142db-978e-4bb4-834d-18b47e90b7be None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:48.582885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bd0142db-978e-4bb4-834d-18b47e90b7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:48.586554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:48.684610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:48.697062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 214/422] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:48.722058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0142db-978e-4bb4-834d-18b47e90b7be None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:48.753291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b9b58-89be-41de-8241-969423060e82 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:48.798825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:48.799959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:48.800441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:48.800913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:48.802368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:48.804211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:48.807827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 209/423] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:48 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:48.814035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:48.873123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:48.903642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0142db-978e-4bb4-834d-18b47e90b7be None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:48.930646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b274b-5da6-48ee-b460-17a52467bb46 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:48.955722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:48.968364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:48.969228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:48.969747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:48.970304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:48.972386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:48.974094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:48.975960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 210/424] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:48 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:48.983466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:48.989015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:48.991471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:48.995674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:48.996229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.016005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:49.029201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:49.030138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:49.031195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:49.041887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 215/425] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:49.058825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:49.148362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f12010-b81c-4894-ad03-a1ba4b5460d9 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:49.187383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd953978-6712-4f22-a33a-5fbee6f6b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:49.188029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953978-6712-4f22-a33a-5fbee6f6b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.188308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953978-6712-4f22-a33a-5fbee6f6b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.188610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd953978-6712-4f22-a33a-5fbee6f6b6a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.189488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953978-6712-4f22-a33a-5fbee6f6b6a6 None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=95fac151c01642568d306e172fe51b4d) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:49.189838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953978-6712-4f22-a33a-5fbee6f6b6a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:49.191423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd953978-6712-4f22-a33a-5fbee6f6b6a6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:49.197605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6023bc57-769e-4b76-a516-98047ab6242a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:49.198550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 211/426] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:48 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:49.200109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cab93-8664-4a47-bae0-b258ba4d85fc None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.200396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cab93-8664-4a47-bae0-b258ba4d85fc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.200670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661cab93-8664-4a47-bae0-b258ba4d85fc None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.202542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 212/427] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:49.208743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6855284-391f-43f9-99ae-4d7364efc1e7 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.208979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6855284-391f-43f9-99ae-4d7364efc1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.209295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6855284-391f-43f9-99ae-4d7364efc1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.231849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a6855284-391f-43f9-99ae-4d7364efc1e7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:49.234121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a6855284-391f-43f9-99ae-4d7364efc1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:49.243901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:49.244154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.244364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.244614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.245467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:49.245845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:49.247274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:49.249966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:49.258053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 216/428] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:49.265439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:49.334706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:49.373970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 213/429] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:49.418185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6855284-391f-43f9-99ae-4d7364efc1e7 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:49.444603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0fcca-691f-4128-8bb1-d3ec17e4fe77 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:49.481052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:49.481681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.481992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.482266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.534661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6855284-391f-43f9-99ae-4d7364efc1e7 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:49.552574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:49.556623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:49.558126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:49.571468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:49.577007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.577007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.577007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.588276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:49.594396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:49.595369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 27 18:04:49.596166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:49.599385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 214/430] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:49.605620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:49.663186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:49.668527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 217/431] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:49.674606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:49.733193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d17fd8-6ccd-4d55-a465-0ca28027c4a3 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:49.772156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:49.773073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.773521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.773992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.775918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] RBAC: Adding query filter params (name=member) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:49.776411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:49.777999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:49.788829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 215/432] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:04:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:49.794309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ef7091-e7d4-418e-bcce-431d1eefee60 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:49.794757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:49.797833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:49.836226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:49.837080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.837520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.837923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] PATH_INFO: `/v3/projects/95fac151c01642568d306e172fe51b4d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.839230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] RBAC: Authorizing `identity:get_project(project_id=95fac151c01642568d306e172fe51b4d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:49.841943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:49.843955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 218/433] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:49 2022] GET /identity/v3/projects/95fac151c01642568d306e172fe51b4d => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:49.849652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:49.924107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13604574-4d62-4299-a8e5-c303b72fae60 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:49.933828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:49.963737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:49.964563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:49.964853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:49.965165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:49.971150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1a3265-dcf0-47f4-874c-4ee067a7287e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.015284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.016763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.017249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.017697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.020201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.022126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.025890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 219/434] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:49 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:50.030720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.045640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.047095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.076136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:50.153662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a10d5-7369-4fac-b93e-2685aec438fd None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.173799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 216/435] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:04:50.180187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.192512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:50.201399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e615b9-d0eb-4d91-9658-c3ab0a89810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.202326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e615b9-d0eb-4d91-9658-c3ab0a89810d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.206593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e615b9-d0eb-4d91-9658-c3ab0a89810d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.206593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e615b9-d0eb-4d91-9658-c3ab0a89810d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.206593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e615b9-d0eb-4d91-9658-c3ab0a89810d None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=95fac151c01642568d306e172fe51b4d) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:50.206593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e615b9-d0eb-4d91-9658-c3ab0a89810d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.206593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e615b9-d0eb-4d91-9658-c3ab0a89810d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.212688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 220/436] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=95fac151c01642568d306e172fe51b4d&role.id=2553b3a661e245038eb65b3da25540d8 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:50.242313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17d6e-f265-4d18-9a0e-cbd1b7ccbdac None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.242937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17d6e-f265-4d18-9a0e-cbd1b7ccbdac None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.243653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a17d6e-f265-4d18-9a0e-cbd1b7ccbdac None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.246511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 221/437] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:50.252579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a300f-a182-4c28-bbe3-dda85c2743a6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.253213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a300f-a182-4c28-bbe3-dda85c2743a6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.253689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a300f-a182-4c28-bbe3-dda85c2743a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.274205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-fc9a300f-a182-4c28-bbe3-dda85c2743a6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:50.275905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fc9a300f-a182-4c28-bbe3-dda85c2743a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:50.308384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab74b7-1506-483a-931c-a050d8a48aa8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.347859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.348569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.348842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.349113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.350424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.351943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.353812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 217/438] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:50.359396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.366123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 222/439] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:50.389502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a300f-a182-4c28-bbe3-dda85c2743a6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.422826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:50.465802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:50.493994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9cf80-1562-4e40-9ad9-fac2c9d03def None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.515914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a300f-a182-4c28-bbe3-dda85c2743a6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.536864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.537510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.537810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.538095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.539397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.540828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.542596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 218/440] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:50.548435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.560893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.561552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.561865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.562146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.574978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:50.582711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:50.583686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:50.584474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:50.585693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 223/441] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:50.591311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.670369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be5733-df24-41f4-8f5f-340ad1d04f43 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.692330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:50.703604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a11ccc-3245-4f7b-924f-dce6a837c829 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.705441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f296ffc-47a3-4db4-b2f6-db049fc5a561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.706718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f296ffc-47a3-4db4-b2f6-db049fc5a561 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.706994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f296ffc-47a3-4db4-b2f6-db049fc5a561 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.707333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f296ffc-47a3-4db4-b2f6-db049fc5a561 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.708118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f296ffc-47a3-4db4-b2f6-db049fc5a561 None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=7eedc9e13d08457aadc35a07c8edc18c, scope.project.id=71e62fb4de31482c912819b934f409df) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:50.708427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f296ffc-47a3-4db4-b2f6-db049fc5a561 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.709873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f296ffc-47a3-4db4-b2f6-db049fc5a561 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.715720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 219/442] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=7eedc9e13d08457aadc35a07c8edc18c => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:50.718003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f1e5-83fb-4177-8f74-fd71e2a5b2fc None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.718294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f1e5-83fb-4177-8f74-fd71e2a5b2fc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.718567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1f1e5-83fb-4177-8f74-fd71e2a5b2fc None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.720782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 220/443] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:50.725707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528c75f-09da-42c6-b9f0-e85534779701 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.726052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528c75f-09da-42c6-b9f0-e85534779701 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.726265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528c75f-09da-42c6-b9f0-e85534779701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.741665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.742348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.742630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.742904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.743634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:50.743939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:50.745365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:50.746591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c528c75f-09da-42c6-b9f0-e85534779701 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:50.747822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c528c75f-09da-42c6-b9f0-e85534779701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:50.750142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:50.760125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 224/444] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:50.761429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.828802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 221/445] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:50.852220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528c75f-09da-42c6-b9f0-e85534779701 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:50.874215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d79aa64-27b4-4469-a82c-37f744e8dd38 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:50.914188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:50.914816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:50.915091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:50.915361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:50.940691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:50.970911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528c75f-09da-42c6-b9f0-e85534779701 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.000107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.002033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.007943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.009307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.009587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.009914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.017905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:51.022462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:51.027536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:51.028511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:51.029448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 222/446] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:51.035606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.122371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 225/447] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:51.128422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.142834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5026b43-31fb-4bb8-9f18-307db7f62a29 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.175549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:51.177004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.177619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.178034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.178343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.179115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:51.179418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.181003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.189623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 223/448] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:51.195194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.225823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16491ef-1ee7-47b0-ba44-259b3f6a415b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.253597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:51.259486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.260127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.260399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.260666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] PATH_INFO: `/v3/projects/71e62fb4de31482c912819b934f409df` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.261815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] RBAC: Authorizing `identity:get_project(project_id=71e62fb4de31482c912819b934f409df)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.263244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.264889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 226/449] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/projects/71e62fb4de31482c912819b934f409df => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:51.270852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.296148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33078028-bc74-4819-a38d-ae79a4161cde None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.329865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.330482 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.331252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.331522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.367288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c2f2d7-d622-4a32-a3c5-0141dd4718ec None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.383312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:51.397274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.398755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.399738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.400377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.400654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.400922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] PATH_INFO: `/v3/groups/470ff254a328400aa0c02e1fd3f425ce` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.402087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] RBAC: Authorizing `identity:get_group(group_id=470ff254a328400aa0c02e1fd3f425ce)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.403497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.405070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 227/450] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/groups/470ff254a328400aa0c02e1fd3f425ce => generated 226 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:51.411736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.458818 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:51.500753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 224/451] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:04:51.506946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.508938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3f7a41-b0f7-424d-b559-cb5f829ada3d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.541867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.542481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.542762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.543033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.543807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] RBAC: Adding query filter params (group.id=470ff254a328400aa0c02e1fd3f425ce, role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=71e62fb4de31482c912819b934f409df) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:51.544112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.545531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.551683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 228/452] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/role_assignments?group.id=470ff254a328400aa0c02e1fd3f425ce&scope.project.id=71e62fb4de31482c912819b934f409df&role.id=2553b3a661e245038eb65b3da25540d8 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:51.607118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebd37bb-dae9-410a-8bf3-c6349a8222e3 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.642375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.643023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.643340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.643607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] PATH_INFO: `/v3/projects/92b4949330f5444faa0288f0a88fa18a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.644791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] RBAC: Authorizing `identity:get_project(project_id=92b4949330f5444faa0288f0a88fa18a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.646277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.647977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 225/453] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/projects/92b4949330f5444faa0288f0a88fa18a => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:04:51.653677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.705494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:51.756857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4002cd-0547-4bc2-ac41-200c37a13c05 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.789706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50330d-5e2e-4ae6-8d89-75ea013c0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.790375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50330d-5e2e-4ae6-8d89-75ea013c0dfe None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.790649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50330d-5e2e-4ae6-8d89-75ea013c0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.790918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50330d-5e2e-4ae6-8d89-75ea013c0dfe None admin] PATH_INFO: `/v3/groups/0fd2941d64a0454e91cadf82a6da43f1` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.792037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50330d-5e2e-4ae6-8d89-75ea013c0dfe None admin] RBAC: Authorizing `identity:get_group(group_id=0fd2941d64a0454e91cadf82a6da43f1)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.793455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50330d-5e2e-4ae6-8d89-75ea013c0dfe None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.795068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 229/454] 10.222.0.67 () {56 vars in 1180 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/groups/0fd2941d64a0454e91cadf82a6da43f1 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:51.801571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:51.833404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:51.905723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f856f8aa-5db6-4382-9ed2-67f62bd94429 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:51.938387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8d572-a77f-42ed-8279-c9b611681c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:51.938986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d572-a77f-42ed-8279-c9b611681c1e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:51.939259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d572-a77f-42ed-8279-c9b611681c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:51.939524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8d572-a77f-42ed-8279-c9b611681c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:51.940935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d572-a77f-42ed-8279-c9b611681c1e None admin] RBAC: Adding query filter params (group.id=0fd2941d64a0454e91cadf82a6da43f1, role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=92b4949330f5444faa0288f0a88fa18a) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:51.941234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d572-a77f-42ed-8279-c9b611681c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:51.942685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8d572-a77f-42ed-8279-c9b611681c1e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:51.948247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 226/455] 10.222.0.67 () {56 vars in 1376 bytes} [Wed Jul 27 18:04:51 2022] GET /identity/v3/role_assignments?group.id=0fd2941d64a0454e91cadf82a6da43f1&scope.project.id=92b4949330f5444faa0288f0a88fa18a&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:54.326824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0b2e-3a3d-4cc6-a825-5adafb0be43a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.327843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0b2e-3a3d-4cc6-a825-5adafb0be43a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.328393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b0b2e-3a3d-4cc6-a825-5adafb0be43a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.330202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 230/456] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:54.336566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87914-da1b-435f-8df5-f28c3b1ad469 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.336978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87914-da1b-435f-8df5-f28c3b1ad469 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.337151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be87914-da1b-435f-8df5-f28c3b1ad469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.363236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7be87914-da1b-435f-8df5-f28c3b1ad469 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:54.364352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7be87914-da1b-435f-8df5-f28c3b1ad469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:54.454506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 227/457] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:54.485972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0b2e-3a3d-4cc6-a825-5adafb0be43a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:54.615461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b0b2e-3a3d-4cc6-a825-5adafb0be43a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:54.622465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d3b9-8532-47d0-a86c-fc5bf3c43dc1 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.622754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d3b9-8532-47d0-a86c-fc5bf3c43dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.623035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436d3b9-8532-47d0-a86c-fc5bf3c43dc1 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.624704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 228/458] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:54.634135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:54.635067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551168f-56f0-40ce-b1f6-63278158a423 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.635358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551168f-56f0-40ce-b1f6-63278158a423 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.635640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b551168f-56f0-40ce-b1f6-63278158a423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.651493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263cca1e-9c64-47b1-90ac-357ae1c675b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:54.652137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cca1e-9c64-47b1-90ac-357ae1c675b0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.652413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cca1e-9c64-47b1-90ac-357ae1c675b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.652681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263cca1e-9c64-47b1-90ac-357ae1c675b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.663581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b551168f-56f0-40ce-b1f6-63278158a423 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:54.664791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b551168f-56f0-40ce-b1f6-63278158a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:54.667569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cca1e-9c64-47b1-90ac-357ae1c675b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:54.669035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263cca1e-9c64-47b1-90ac-357ae1c675b0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-263cca1e-9c64-47b1-90ac-357ae1c675b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:54.683642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:54.684510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:54.685353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:54.685353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:54.685353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:54.685353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:54.685353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 231/459] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:54.686164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:54.686366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d33c6-51d9-405a-a660-961fde50fc0a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.687115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d33c6-51d9-405a-a660-961fde50fc0a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.687394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2d33c6-51d9-405a-a660-961fde50fc0a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.688873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 232/460] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:54.694673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4551b14-61cf-4c0c-b4ff-34740d145c45 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.699882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4551b14-61cf-4c0c-b4ff-34740d145c45 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.699882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4551b14-61cf-4c0c-b4ff-34740d145c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.713733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d4551b14-61cf-4c0c-b4ff-34740d145c45 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:54.715114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d4551b14-61cf-4c0c-b4ff-34740d145c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:54.749786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 229/461] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:54.749786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551168f-56f0-40ce-b1f6-63278158a423 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:54.808715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 233/462] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:54.818800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4551b14-61cf-4c0c-b4ff-34740d145c45 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:54.849559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b551168f-56f0-40ce-b1f6-63278158a423 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:54.888642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:54.889394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.890181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.890181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.890807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:54.891110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:54.892546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:54.906807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 230/463] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:54.907663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:54.926200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:54.938195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:54.941426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4551b14-61cf-4c0c-b4ff-34740d145c45 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:54.976765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:54.977811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:54.978330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:54.978797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:54.989185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:54.991018 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:55.006541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:55.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:55.008254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:55.008254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:55.008254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:55.008254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:55.010083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 234/464] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:55.012200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:55.016217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55503e-cb26-4077-b3a5-dc176e5df3dc None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:55.053849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:55.054496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.054775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.055049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.066556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:55.068101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:55.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:55.084856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:55.086108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:55.086108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:55.086108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:55.086108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:55.086108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 231/465] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:55.090510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:55.124379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e9353b-f6f7-42a0-8e89-42db6c059e39 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:55.158410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:55.161026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b745f4-995e-4546-a638-6091223a67f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:55.161916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b745f4-995e-4546-a638-6091223a67f7 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.162546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b745f4-995e-4546-a638-6091223a67f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.163016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b745f4-995e-4546-a638-6091223a67f7 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.164362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b745f4-995e-4546-a638-6091223a67f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:55.166607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b745f4-995e-4546-a638-6091223a67f7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.199171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a610a2b4-c132-42b8-878d-a6c4091f9183 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:55.233172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:55.233873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.234159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.234437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.235129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:55.235454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:55.236858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.248678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 232/466] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:55.249469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:55.285668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 235/467] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:55 2022] POST /identity/v3/users => generated 246 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:55.287361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c30c2b-915e-4ff1-801a-efd564762338 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.287717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c30c2b-915e-4ff1-801a-efd564762338 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.288063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c30c2b-915e-4ff1-801a-efd564762338 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.293665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 236/468] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:55.293665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c30c2b-915e-4ff1-801a-efd564762338 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:55.306285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:55.383831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f4dd3-3556-45e8-9b45-661198864bfd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:55.417806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:55.428226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c30c2b-915e-4ff1-801a-efd564762338 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:55.435904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a50d2-324e-4dd0-8b69-57082139d89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:55.436689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a50d2-324e-4dd0-8b69-57082139d89a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.437065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a50d2-324e-4dd0-8b69-57082139d89a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.438176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a50d2-324e-4dd0-8b69-57082139d89a None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.439067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a50d2-324e-4dd0-8b69-57082139d89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:55.439466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a50d2-324e-4dd0-8b69-57082139d89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:55.442675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a50d2-324e-4dd0-8b69-57082139d89a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.459860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 233/469] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:55.462001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d7b79-b0b5-4cf8-8c66-56709a43760e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.462322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d7b79-b0b5-4cf8-8c66-56709a43760e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.462600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012d7b79-b0b5-4cf8-8c66-56709a43760e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.476322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:55.476955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.478070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.478070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.478670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:55.480075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.484315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-012d7b79-b0b5-4cf8-8c66-56709a43760e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:55.485199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-012d7b79-b0b5-4cf8-8c66-56709a43760e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:55.563453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 234/470] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:55.564389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d7b79-b0b5-4cf8-8c66-56709a43760e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:55.570457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 237/471] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:55 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:55.601223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:55.730552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:55.756051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012d7b79-b0b5-4cf8-8c66-56709a43760e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:55.771418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:55.776157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686bc7db-2691-4c64-bcd9-fde185c04f45 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:55.792689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ce991-5601-45bc-b80a-b57b0a6f72bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:55.793608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce991-5601-45bc-b80a-b57b0a6f72bc None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.793928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce991-5601-45bc-b80a-b57b0a6f72bc None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.794249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ce991-5601-45bc-b80a-b57b0a6f72bc None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.794934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce991-5601-45bc-b80a-b57b0a6f72bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:55.796860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ce991-5601-45bc-b80a-b57b0a6f72bc None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.818667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:55.820021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.820021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.820021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.832472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:55.834278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:55.854119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:55.854994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:55.855832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:55.855832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:55.855832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:55.855832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:55.857455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 238/472] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:04:55.864066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:55.892330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 235/473] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:55 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:55.893684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0cf55-40bd-4b22-bc51-f39bb69a0d43 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.894114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0cf55-40bd-4b22-bc51-f39bb69a0d43 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.894395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0cf55-40bd-4b22-bc51-f39bb69a0d43 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.895767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 236/474] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:55.901312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3570c-386b-49bf-92dc-bb4f33ab6fbb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:55.901604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3570c-386b-49bf-92dc-bb4f33ab6fbb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:55.901906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f3570c-386b-49bf-92dc-bb4f33ab6fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:55.925313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d9f3570c-386b-49bf-92dc-bb4f33ab6fbb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:55.926565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d9f3570c-386b-49bf-92dc-bb4f33ab6fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:56.003361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 237/475] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:04:56.019109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8275bb-262e-4fb5-8037-264e0516f143 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:56.038426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3570c-386b-49bf-92dc-bb4f33ab6fbb None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:56.048290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:56.070016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:56.072299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:56.072299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:56.072299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:56.072526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:56.072902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:56.074457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:56.090108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 239/476] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:56.097821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:56.193053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:56.197069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f3570c-386b-49bf-92dc-bb4f33ab6fbb None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:56.226046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09c4db8-c912-4243-a074-139f161768fe None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:56.235523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:56.236361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:56.237441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:56.237924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:56.238832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:56.240345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:56.265021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:56.265620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:56.265927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:56.266238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:56.266909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:56.268416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:56.297159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.sql.core [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:04:56.297159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 18:04:56.297159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [parameters: {'id': '6dbc554eff66485b9ead55ac653e7f78', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 18:04:56.297159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80552) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result.read() Jul 27 18:04:56.314071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return ref.to_dict() Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:04:56.315078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application yield resource Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise self.value Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application session.commit() Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:04:56.315985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:04:56.316820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:04:56.317696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result.read() Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:04:56.319973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [parameters: {'id': '6dbc554eff66485b9ead55ac653e7f78', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:56.321905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 27 18:04:56.323821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:56.326167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 238/477] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 18:04:56 2022] POST /identity/v3/roles => generated 144 bytes in 278 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:56.326167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:56.429893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9d0bd-fd7c-4104-a471-68915f104427 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:56.448532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 240/478] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:04:56 2022] POST /identity/v3/users => generated 249 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:04:56.482486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ab28fb-052e-4904-bebc-73f696e358f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:56.483503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab28fb-052e-4904-bebc-73f696e358f4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:56.483956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab28fb-052e-4904-bebc-73f696e358f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:56.484370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ab28fb-052e-4904-bebc-73f696e358f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:56.510958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ab28fb-052e-4904-bebc-73f696e358f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-f5ab28fb-052e-4904-bebc-73f696e358f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:56.516525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:56.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 27 18:04:56.519204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:56.521383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 239/479] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:04:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:56.527485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:56.571420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:56.664823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937b4acb-785a-4e61-b95e-0a6e5ebd8cf2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:56.702945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35098f5d-4947-449e-865a-68bf4b8144fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:56.703938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098f5d-4947-449e-865a-68bf4b8144fc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:56.704436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098f5d-4947-449e-865a-68bf4b8144fc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:56.704913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35098f5d-4947-449e-865a-68bf4b8144fc None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:56.706421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35098f5d-4947-449e-865a-68bf4b8144fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:56.706925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35098f5d-4947-449e-865a-68bf4b8144fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:56.708516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35098f5d-4947-449e-865a-68bf4b8144fc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:56.719847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 241/480] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:04:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:57.675833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909d7f2-4d8d-41f6-a023-86fe4d663482 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:57.676350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909d7f2-4d8d-41f6-a023-86fe4d663482 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:57.676447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909d7f2-4d8d-41f6-a023-86fe4d663482 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:57.678062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 240/481] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:57.683290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87eee-4522-4bb3-950f-3e1a4148c256 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:57.683685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87eee-4522-4bb3-950f-3e1a4148c256 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:57.683850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a87eee-4522-4bb3-950f-3e1a4148c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:57.707478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-83a87eee-4522-4bb3-950f-3e1a4148c256 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:57.708674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-83a87eee-4522-4bb3-950f-3e1a4148c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:57.788096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 242/482] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:57.819534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909d7f2-4d8d-41f6-a023-86fe4d663482 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:57.849396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:57.956116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909d7f2-4d8d-41f6-a023-86fe4d663482 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.003091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.003746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.004024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.004297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.022189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:58.027152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:58.028018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:58.028808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 241/483] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:58.036044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87eee-4522-4bb3-950f-3e1a4148c256 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.069157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:58.157544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a87eee-4522-4bb3-950f-3e1a4148c256 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.201162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ac9ab-479f-4169-b437-c4dd614e5451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.201803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ac9ab-479f-4169-b437-c4dd614e5451 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.202090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ac9ab-479f-4169-b437-c4dd614e5451 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.202364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ac9ab-479f-4169-b437-c4dd614e5451 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.203080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ac9ab-479f-4169-b437-c4dd614e5451 None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:58.203384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ac9ab-479f-4169-b437-c4dd614e5451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:58.204757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ac9ab-479f-4169-b437-c4dd614e5451 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:58.213328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 243/484] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:58.218938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.331282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecab7ff-f429-499c-acee-7048499ffb27 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.331603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecab7ff-f429-499c-acee-7048499ffb27 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.331842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecab7ff-f429-499c-acee-7048499ffb27 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.333326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 244/485] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:04:58.339321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b519265-c243-4add-bced-44e11e121069 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.339610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b519265-c243-4add-bced-44e11e121069 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.339887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b519265-c243-4add-bced-44e11e121069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.348713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:58.358748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c24bcb-f834-4a3c-9a4d-a3e999934122 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.361741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9b519265-c243-4add-bced-44e11e121069 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:58.365398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9b519265-c243-4add-bced-44e11e121069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:58.409284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958cbb05-a56c-4665-8602-515b3a32ce8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.409970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbb05-a56c-4665-8602-515b3a32ce8e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.410249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbb05-a56c-4665-8602-515b3a32ce8e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958cbb05-a56c-4665-8602-515b3a32ce8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.420976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cbb05-a56c-4665-8602-515b3a32ce8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:58.422518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958cbb05-a56c-4665-8602-515b3a32ce8e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-958cbb05-a56c-4665-8602-515b3a32ce8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:58.437657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:58.438562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:58.439392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:58.439392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:58.439392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:58.439392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:58.440212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 242/486] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:58.444992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635235c8-5441-485a-8b66-9daeb6ad58c8 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.444992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635235c8-5441-485a-8b66-9daeb6ad58c8 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.444992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635235c8-5441-485a-8b66-9daeb6ad58c8 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.445276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 245/487] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:58.445379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 243/488] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:58.446165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b519265-c243-4add-bced-44e11e121069 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.448725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f6d0-5fa4-42c5-bb24-75faa3dad20d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.449207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f6d0-5fa4-42c5-bb24-75faa3dad20d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.449580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1156f6d0-5fa4-42c5-bb24-75faa3dad20d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.474253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:58.477739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-1156f6d0-5fa4-42c5-bb24-75faa3dad20d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:58.478986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1156f6d0-5fa4-42c5-bb24-75faa3dad20d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:58.557946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 244/489] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:58.558843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f6d0-5fa4-42c5-bb24-75faa3dad20d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.559976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b519265-c243-4add-bced-44e11e121069 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.595554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.596391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.596772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.597196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.598025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:58.598469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:58.599980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:58.613852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 246/490] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:58.614972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.650745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:58.686923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1156f6d0-5fa4-42c5-bb24-75faa3dad20d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.698531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:58.725853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93123f7b-f3eb-4550-8530-bf6d51b93bdc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.726670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.727606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.728132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.728604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.739630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:58.746022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:58.746888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:58.747682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:58.754980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 245/491] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:58.756312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.761377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.761923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.762207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.762479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.774000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:58.779709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:58.780836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:58.781612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 247/492] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:58.782309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.869541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a394e2fc-4f78-44a6-b68e-d1d96eba7a30 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.886509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059403-df96-456d-8a31-b27190b182b1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:58.897278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:58.907265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.909128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.909607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.910376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.918589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:58.920195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:58.926002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f237f1-3ce3-4ad9-9fce-35bcb79d063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:58.926627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f237f1-3ce3-4ad9-9fce-35bcb79d063a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.926911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f237f1-3ce3-4ad9-9fce-35bcb79d063a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.927187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f237f1-3ce3-4ad9-9fce-35bcb79d063a None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.927897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f237f1-3ce3-4ad9-9fce-35bcb79d063a None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:58.928251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f237f1-3ce3-4ad9-9fce-35bcb79d063a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:58.929606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f237f1-3ce3-4ad9-9fce-35bcb79d063a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:58.932127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:04:58.933911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:58.934763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:04:58.935635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:58.937903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 246/493] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:58.943039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:58.944172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 248/494] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:58.945293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04948c-c7a4-426d-8205-1591af774ba7 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:58.945581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04948c-c7a4-426d-8205-1591af774ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:58.945902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04948c-c7a4-426d-8205-1591af774ba7 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:58.951224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 249/495] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:58.951224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04948c-c7a4-426d-8205-1591af774ba7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.048467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27d6d48-7684-4732-ae1c-fffed47d0249 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.059455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04948c-c7a4-426d-8205-1591af774ba7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.084382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.085166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.085466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.085725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.086470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:59.086776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.088152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.095351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb85193-1535-4927-b50a-06a6809e798f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.096517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85193-1535-4927-b50a-06a6809e798f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.096832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85193-1535-4927-b50a-06a6809e798f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.097107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb85193-1535-4927-b50a-06a6809e798f None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.097939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb85193-1535-4927-b50a-06a6809e798f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:59.098251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb85193-1535-4927-b50a-06a6809e798f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.101355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb85193-1535-4927-b50a-06a6809e798f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.102103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 247/496] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:59.103008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.140306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 250/497] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:04:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:59.141571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed4f99-bc78-43cb-8c1b-34132f1c5928 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.141888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed4f99-bc78-43cb-8c1b-34132f1c5928 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.142163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed4f99-bc78-43cb-8c1b-34132f1c5928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.160726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.162074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b7ed4f99-bc78-43cb-8c1b-34132f1c5928 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:59.163263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b7ed4f99-bc78-43cb-8c1b-34132f1c5928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:59.213792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.216951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cd2dcb-f92d-456b-8fd8-3928222ac726 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.231030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 251/498] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:04:59.231763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed4f99-bc78-43cb-8c1b-34132f1c5928 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.261408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.262082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.262360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.262630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.274919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.277030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:59.292637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:59.293518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:59.294725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:59.294725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:59.294725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:59.294725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:59.294725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 248/499] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:59.294725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.342242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed4f99-bc78-43cb-8c1b-34132f1c5928 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.378945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.379687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.379975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.380255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.390678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.392154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:59.408289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:59.409714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:59.410588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:59.410588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:59.410588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:59.410588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:59.410588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 252/500] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:59.410852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.417382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.420661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570efb75-665c-4ae8-a4c7-2d9fa8214eef None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.455972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.456914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.457537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.457853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.458611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.515933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519ddfed-5eb6-4bbf-99b7-be1d1630f816 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.532782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.534888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.552646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.553285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.553566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.553869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.563727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:04:59.568626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:59.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:04:59.570555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 253/501] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:59.571205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.635077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.638677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 249/502] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:04:59.639475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.672353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.676052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03758c36-1e41-4fbe-bcf9-390e30c5117e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.709737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a766bdff-e322-4b9d-bcc6-76274e786c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.710375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766bdff-e322-4b9d-bcc6-76274e786c30 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.710649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766bdff-e322-4b9d-bcc6-76274e786c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.710919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a766bdff-e322-4b9d-bcc6-76274e786c30 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.711599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766bdff-e322-4b9d-bcc6-76274e786c30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:59.711900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766bdff-e322-4b9d-bcc6-76274e786c30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.713270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a766bdff-e322-4b9d-bcc6-76274e786c30 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.724222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 254/503] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:59.725459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7f9a8-d3ed-4f50-bce6-ff00b00366e7 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.725808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7f9a8-d3ed-4f50-bce6-ff00b00366e7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.726118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7f9a8-d3ed-4f50-bce6-ff00b00366e7 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.727490 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 255/504] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:04:59.728103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7f9a8-d3ed-4f50-bce6-ff00b00366e7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.743452 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d0a1a3-0578-4e6f-96d9-6ce018205b3a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.777336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.777973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.778249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.778512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.779184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:59.779476 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.781104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.792110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 250/505] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:59.792943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.837275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7f9a8-d3ed-4f50-bce6-ff00b00366e7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.850590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.869340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.869983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.870268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.870544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.871256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:04:59.871559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.872986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.881516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 256/506] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:04:59.882349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:04:59.896015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c0e8b5-e817-489d-a307-aa8efcaaa942 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:04:59.903964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:04:59.929142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9212f5de-0606-4ee0-aa28-b707c46b2e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:04:59.929791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f5de-0606-4ee0-aa28-b707c46b2e43 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.930070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f5de-0606-4ee0-aa28-b707c46b2e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.930358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9212f5de-0606-4ee0-aa28-b707c46b2e43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.941157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212f5de-0606-4ee0-aa28-b707c46b2e43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:04:59.942609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9212f5de-0606-4ee0-aa28-b707c46b2e43 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-9212f5de-0606-4ee0-aa28-b707c46b2e43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:04:59.956826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:04:59.957635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:04:59.958495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:04:59.958495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:04:59.958495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:04:59.958495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:04:59.958495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 251/507] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:04:59.959087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59798d7-148d-4e74-b2ed-7fe89e2d9ed5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:04:59.959359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59798d7-148d-4e74-b2ed-7fe89e2d9ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:04:59.959630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59798d7-148d-4e74-b2ed-7fe89e2d9ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:04:59.977057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b59798d7-148d-4e74-b2ed-7fe89e2d9ed5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:04:59.978280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b59798d7-148d-4e74-b2ed-7fe89e2d9ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:04:59.984975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291a7207-d944-4778-8d98-a2be7e1189b0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.020260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.020891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.021165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.021433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.028243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.029681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:00.042359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:00.043395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 257/508] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:04:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:00.044289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.045004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 252/509] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:04:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:00.045249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59798d7-148d-4e74-b2ed-7fe89e2d9ed5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.089692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.143154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.148552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59798d7-148d-4e74-b2ed-7fe89e2d9ed5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.162265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613ced7-1808-4507-87e1-6f411cd76757 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.182796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.183428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.183706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.183981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.194386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.195839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.196282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.196913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.197189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.197464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.204327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.206335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:00.211257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:00.212243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:00.213325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:00.213325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:00.213325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:00.213325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:00.213325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 253/510] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:00.213325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:00.222874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:00.223921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 258/511] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:00.224938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.309584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.315887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f7475-2cf6-40b9-9194-428ea4582c18 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.324510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a871d313-7e8f-485a-bfc3-8425d59d1053 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.348973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.349589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.349913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.350190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.350930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:00.351234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.352622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.357743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.358372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.358649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.358919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.359697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:00.359998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.361447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.364908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 254/512] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:00.365831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.371210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.379263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 259/513] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:00.383902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.468581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4694fee-485b-4087-a076-fbce2240a83e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.481153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe5d5c-3cf8-4d3d-9c9b-da3f4152f58c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.500994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a5163-8c44-421f-973b-14e76003297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.501756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a5163-8c44-421f-973b-14e76003297c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.502697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a5163-8c44-421f-973b-14e76003297c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.502869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a5163-8c44-421f-973b-14e76003297c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.512701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a5163-8c44-421f-973b-14e76003297c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.513986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.514174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a5163-8c44-421f-973b-14e76003297c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.514597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.514876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.515149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.515831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:00.516132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.517493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.528991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 260/514] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-227a5163-8c44-421f-973b-14e76003297c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:00.529112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:00.530194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:00.531025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:00.531025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:00.531025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:00.531025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:00.531244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.531314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 255/515] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:00.531378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a5163-8c44-421f-973b-14e76003297c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.542078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.590893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.632578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8b9db5-582e-4314-84a4-482d7d472edd None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.634069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a5163-8c44-421f-973b-14e76003297c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.665375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.666132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.666514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.666795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.667132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.667570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:00.667765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.667860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.668047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.668321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.669278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.674970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.676390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.685646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 261/516] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:00.686464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:00.688305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:00.689104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:00.690492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 256/517] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:00.691269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.755481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.786432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cae8fc-ae36-4daf-8226-ee2e0748a2ec None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.790426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644c3e7-c25d-4bb1-86f8-b37dda4d9416 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.802678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.820231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.820850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.821132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.821405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.824240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.824867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.825140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.825406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.833066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.834602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:00.845695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:00.846667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:00.847537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 257/518] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:00.848100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:00.891915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.893459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.947297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70c3160-ec38-4de6-9d17-a4d29f6f9733 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:00.973448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:00.981679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:00.982313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:00.982585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:00.983118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:00.983517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:00.983814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:00.985157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:00.990060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 262/519] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:00.990975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.001162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 258/520] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:01.001162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.008548 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:01.089167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e79e070-9dbf-449b-87c6-ef22d4e719ad None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.094990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183d0b1-ba1b-4ed5-a0ee-95913a8f82ba None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.127971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.128441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.128589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.128864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.129058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.129150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.129337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.129634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.130416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:01.130722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.133063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.151031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 259/521] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:01.151908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.197437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.198149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:01.198949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.215481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:01.251240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e68bdb-232e-4ef0-b7b7-33d8f4363ed9 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.284617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.285172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.285553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.285687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.286498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:01.286792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.288200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.298120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 263/522] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:01.299574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.326940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 260/523] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 27 18:05:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:01.327746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.401984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef020af-b643-481d-9a56-894b731220a0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.418007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:01.425583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9ee3e-9026-4572-81e6-5354d4655d8b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.431650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:01.435646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.436285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.436564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.436836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.446912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.448373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.458477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.459086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.459367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.459642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.460314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.461736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:01.463162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:01.464142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:01.465016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:01.465016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:01.465016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:01.465016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:01.465016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 264/524] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:01.465427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.541621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 261/525] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:05:01 2022] POST /identity/v3/users => generated 247 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:01.542449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.568382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1ddfe-5c7b-4a08-8148-076a7643aa5f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.614072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.614711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.614989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.615263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.616087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=4e107a27b86243dcbb160a3960682b2d) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:01.616391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.617874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.626652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 265/526] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:01 2022] GET /identity/v3/role_assignments?user.id=4e107a27b86243dcbb160a3960682b2d&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:01.627908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.673478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54395a12-ff5f-42b0-8dbb-3d221979614e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.684243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:01.729578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.730421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.730807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.731182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.744921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.746478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:01.765556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:01.766973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:01.768366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:01.768366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:01.768366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:01.768366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:01.768366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 262/527] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:01.768366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.784970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118afba0-0902-48d8-81e1-38474cb803f5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.790682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:01.835592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.837174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.837864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.838415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.886729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6cd0d7-657a-4d51-bec2-b55ebca9ac57 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:01.930081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:01.930709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:01.930991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:01.931266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:01.931964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:01.932270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.934638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.936967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:01.939253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:01.950043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 263/528] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:01.950921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:01.980557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.051841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.079056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 266/529] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:02.080833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.083815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14af33de-2fe6-48b3-bd1d-654664c5931e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.125731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.126471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.126762 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.127064 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.127762 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:02.128065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.129435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.141874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 264/530] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:02.142537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.194224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e5d546-4f6b-4d7c-a3c9-51d1544b0839 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.225220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.231946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.232946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.233544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.234051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.242097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.244064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.248968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f22ef6-5865-4709-a5f0-170e3b2ac716 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:02.257340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:02.258227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:02.259085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:02.261711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 267/531] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:02.262935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.281202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.286894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.295109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.295109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.295109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.299842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.301413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:02.316788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:02.317676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:02.318582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:02.318582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:02.318582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:02.318582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:02.318582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 265/532] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:02.319277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622cbe45-02d8-48b9-ba16-a1f51ced64cc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.419784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.420914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.421430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.422006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.427651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1927c-c5a7-4f2b-8ada-d5f7c96687c7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.430046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.431704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:02.444078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:02.444895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:02.445714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:02.448179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 268/533] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:02.449152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.462682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.463324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.463842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.463947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.464680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:02.465065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.466442 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.480806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 266/534] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:02.481751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.507558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.529084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.558836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5494ba98-ec2c-4f36-9898-2c896f716229 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.587198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300227da-c6a4-4e45-bd1d-326136c6abf2 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.594538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.595350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.595623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.596032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.596777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:02.597143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.598705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.611967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 269/535] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:02.612851 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.625355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.626329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.626814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.627877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.628918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:02.629419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.631147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.644385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 267/536] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:02.645529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.721570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7445-7b72-4c31-9f94-1112ec883025 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.736488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.753475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee021ac3-e4ca-42c0-89fd-a0510d6c6b65 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.756357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:02.758077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.758703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.758980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.759251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.760036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=9d4eba8e853c41bcbd92d6cab54efd0e) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:02.760341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.761859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.768828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 270/537] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/role_assignments?user.id=9d4eba8e853c41bcbd92d6cab54efd0e&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:02.769783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.793817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.804432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.804432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.804432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.806574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:02.809000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:02.826242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:02.827329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:02.828319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 268/538] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:02.833943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:02.952341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c2b10-8fe4-479c-a065-22d0aab9a7b9 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.991615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:02.992431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:02.992959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:02.993330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:02.993605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71ee62-9619-42c0-a410-5e87ec51e8b6 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:02.994311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:02.994714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:03.001826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:03.012285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 269/539] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:03.018604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:03.048660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:03.050836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac0594-eb25-4d05-adb1-5a63c3ef4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:03.051538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac0594-eb25-4d05-adb1-5a63c3ef4085 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:03.051927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac0594-eb25-4d05-adb1-5a63c3ef4085 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:03.052272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac0594-eb25-4d05-adb1-5a63c3ef4085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:03.053170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac0594-eb25-4d05-adb1-5a63c3ef4085 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=0d75852e9db24464bd69c0c19b75ab39) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:03.053539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac0594-eb25-4d05-adb1-5a63c3ef4085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:03.055135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac0594-eb25-4d05-adb1-5a63c3ef4085 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:03.061717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 271/540] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:02 2022] GET /identity/v3/role_assignments?user.id=0d75852e9db24464bd69c0c19b75ab39&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:03.153333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66da356-0af2-453d-89e4-9836214bee0f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:03.201468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cb6523-42db-459a-b2f1-34adb329bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:03.202124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6523-42db-459a-b2f1-34adb329bb59 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:03.202457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6523-42db-459a-b2f1-34adb329bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:03.202676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cb6523-42db-459a-b2f1-34adb329bb59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:03.203474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6523-42db-459a-b2f1-34adb329bb59 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=052da4ed2e054c70ba8b0bf9b6c5656a) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:03.203782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6523-42db-459a-b2f1-34adb329bb59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:03.205752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cb6523-42db-459a-b2f1-34adb329bb59 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:03.218276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 270/541] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:03 2022] GET /identity/v3/role_assignments?user.id=052da4ed2e054c70ba8b0bf9b6c5656a&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:03.766112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929db35-c54a-4b91-b518-517ed737820a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:03.766482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929db35-c54a-4b91-b518-517ed737820a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:03.766673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929db35-c54a-4b91-b518-517ed737820a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:03.768911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 272/542] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:03.774122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633f43-98c6-4f00-ab7c-55f58c7b747c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:03.774406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633f43-98c6-4f00-ab7c-55f58c7b747c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:03.774683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7633f43-98c6-4f00-ab7c-55f58c7b747c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:03.799280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-f7633f43-98c6-4f00-ab7c-55f58c7b747c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:03.800492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f7633f43-98c6-4f00-ab7c-55f58c7b747c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:03.854373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51867-1f43-4bd4-b1ec-afc78e2517ff None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:03.854675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51867-1f43-4bd4-b1ec-afc78e2517ff None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:03.854926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e51867-1f43-4bd4-b1ec-afc78e2517ff None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:03.857265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 273/543] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:03.861668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81aea8-c40c-4e89-9c60-b1874df5af45 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:03.861981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81aea8-c40c-4e89-9c60-b1874df5af45 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:03.862257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81aea8-c40c-4e89-9c60-b1874df5af45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:03.894065 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-5f81aea8-c40c-4e89-9c60-b1874df5af45 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:03.895260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5f81aea8-c40c-4e89-9c60-b1874df5af45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:03.906544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 271/544] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:03.946729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633f43-98c6-4f00-ab7c-55f58c7b747c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:03.956884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:03.986123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:04.014977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 274/545] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:04.052450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81aea8-c40c-4e89-9c60-b1874df5af45 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:04.131567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7633f43-98c6-4f00-ab7c-55f58c7b747c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:04.188711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:04.189899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:04.190186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:04.190458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:04.198530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81aea8-c40c-4e89-9c60-b1874df5af45 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:04.218105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:04.225229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:04.226161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:04.226946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:04.229687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 272/546] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:04.235271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:04.272029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:04.272687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:04.273120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:04.273404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:04.326438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:04.331312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:04.332175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:04.333039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 275/547] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:04.338274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:04.338812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:04.350329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27742eff-c81d-4ba7-a704-d0e7753240e0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:04.386935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:04.387720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:04.388010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:04.388291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:04.389059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:04.389363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:04.391193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:04.400024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 273/548] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:04.406759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:04.450121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:04.558958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4daa4e-378c-494b-b39f-eea454ec2e7a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:04.579198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41182fbf-abef-4921-9fbe-750060aeffde None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:04.627488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:04.628114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:04.628395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:04.628666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:04.629386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:04.629686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:04.631085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:04.643187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:04.643830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:04.644105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:04.644375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:04.649319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 276/549] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:04.654392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:04.669109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:04.672402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:04.674512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:04.700255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:04.701210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:04.702099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:04.702099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:04.702099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:04.702099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:04.707119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 274/550] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:04.710644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:04.808816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:04.819210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243295c-5f7c-4218-a090-f479bcf11397 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:04.858573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:04.859194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:04.859474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:04.859864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:04.881219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:04.882714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:04.905112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:04.906128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:04.906984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:04.906984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:04.906984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:04.906984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:04.906984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 277/551] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:04.912275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:04.927019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e571fd-bc13-43f2-98b8-ceb27607c5d1 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:04.989464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:04.990113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:04.990394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:04.990665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:04.991355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:04.991660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:04.993052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.007611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 275/552] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:05.013152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.078658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d7eb5-e112-46fd-a304-78e73a4c08af None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.114167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.116958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b808e7d-f56f-4de7-9b12-e1d360e3d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.120794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b808e7d-f56f-4de7-9b12-e1d360e3d255 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.120794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b808e7d-f56f-4de7-9b12-e1d360e3d255 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.120794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b808e7d-f56f-4de7-9b12-e1d360e3d255 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.120794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b808e7d-f56f-4de7-9b12-e1d360e3d255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:05.120794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b808e7d-f56f-4de7-9b12-e1d360e3d255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:05.128607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b808e7d-f56f-4de7-9b12-e1d360e3d255 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.138118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 278/553] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:05.139453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1f2a9-19e5-4873-a17f-efcb80eed15c None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.139738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1f2a9-19e5-4873-a17f-efcb80eed15c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.140011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c1f2a9-19e5-4873-a17f-efcb80eed15c None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.141554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 279/554] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:05.143787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1f2a9-19e5-4873-a17f-efcb80eed15c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.151957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.175954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f66447-96f0-4a74-8d34-0eaa3a1aebf0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.220250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f0cd20-1b2b-420e-8db4-d39b47a3f97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.221110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0cd20-1b2b-420e-8db4-d39b47a3f97f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.221548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0cd20-1b2b-420e-8db4-d39b47a3f97f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.221863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f0cd20-1b2b-420e-8db4-d39b47a3f97f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.232124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0cd20-1b2b-420e-8db4-d39b47a3f97f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:05.233650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f0cd20-1b2b-420e-8db4-d39b47a3f97f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-d8f0cd20-1b2b-420e-8db4-d39b47a3f97f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:05.249081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:05.250071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:05.250985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:05.253840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 276/555] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:05.255317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc32450-a8e9-4e8f-877e-170cb66b7cbd None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.255793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc32450-a8e9-4e8f-877e-170cb66b7cbd None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.257063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc32450-a8e9-4e8f-877e-170cb66b7cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.278969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6dc32450-a8e9-4e8f-877e-170cb66b7cbd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:05.280408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6dc32450-a8e9-4e8f-877e-170cb66b7cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:05.281691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c1f2a9-19e5-4873-a17f-efcb80eed15c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.318743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.319783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.320263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.320770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.328849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:05.330726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:05.343214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:05.344201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:05.345602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:05.348298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 280/556] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:05.349311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.366205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 277/557] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:05.367149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc32450-a8e9-4e8f-877e-170cb66b7cbd None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.427930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.433594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.485528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72aa08b-58c1-47fe-9ba9-fd490615485e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.490060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc32450-a8e9-4e8f-877e-170cb66b7cbd None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.527526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.528145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.528419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.528686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.529468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:05.529713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.530099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:05.530906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.531407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.531524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.531982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.533157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:05.533670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:05.536246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.555758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 278/558] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:05.556666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.561980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 281/559] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:05.562712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.668214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e425382-2419-4137-ad6f-f4beca52def4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.672080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.675697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd119e-159d-45ca-9fb1-c4ca6fc126eb None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.691029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.702291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a56d8c-7525-479c-9802-73e0597b2ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.702909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a56d8c-7525-479c-9802-73e0597b2ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.703189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a56d8c-7525-479c-9802-73e0597b2ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.703538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a56d8c-7525-479c-9802-73e0597b2ae6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.711691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.712325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.712601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.712867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.723216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:05.727989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:05.729006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:05.729872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 279/560] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:05.730706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.774324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a56d8c-7525-479c-9802-73e0597b2ae6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:05.775792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a56d8c-7525-479c-9802-73e0597b2ae6 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.827060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c10263a-d236-4430-b672-8556715ea3b8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.859569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:05.860194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.860473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.860746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.872029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 282/561] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:05.872559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:05.873264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaca41-1bd1-451a-8b00-a16d0ec314f7 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.873548 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaca41-1bd1-451a-8b00-a16d0ec314f7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.873844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aaca41-1bd1-451a-8b00-a16d0ec314f7 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.874037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:05.877145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 283/562] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:05.877145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26454c3-7a42-47b6-b934-b2c00d59d495 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:05.877145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26454c3-7a42-47b6-b934-b2c00d59d495 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:05.877145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26454c3-7a42-47b6-b934-b2c00d59d495 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:05.878315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 284/563] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:05.879027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26454c3-7a42-47b6-b934-b2c00d59d495 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:05.894642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:05.898878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:05.899868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:05.899868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:05.899868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:05.899868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:05.899868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 280/564] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:05.899868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:05.903489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.913246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:05.981619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26454c3-7a42-47b6-b934-b2c00d59d495 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:05.997489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ee33f-dcaf-4fe1-ae80-ec1d204b7e90 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.015090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a55189f-2f5e-45ca-9012-3d4cf8e9de4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.015708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55189f-2f5e-45ca-9012-3d4cf8e9de4f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.015981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55189f-2f5e-45ca-9012-3d4cf8e9de4f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.016253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a55189f-2f5e-45ca-9012-3d4cf8e9de4f None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.016950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55189f-2f5e-45ca-9012-3d4cf8e9de4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:06.017251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55189f-2f5e-45ca-9012-3d4cf8e9de4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.019189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a55189f-2f5e-45ca-9012-3d4cf8e9de4f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.026937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 285/565] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:06.028076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f47b-6b83-4c4b-b813-2d40f94fea5f None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.028355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f47b-6b83-4c4b-b813-2d40f94fea5f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.028627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed0f47b-6b83-4c4b-b813-2d40f94fea5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.037290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca48061-480c-45ce-ae1e-1464e3712f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.037967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48061-480c-45ce-ae1e-1464e3712f6a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.038299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48061-480c-45ce-ae1e-1464e3712f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.038575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca48061-480c-45ce-ae1e-1464e3712f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.045673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-4ed0f47b-6b83-4c4b-b813-2d40f94fea5f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:06.046876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4ed0f47b-6b83-4c4b-b813-2d40f94fea5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:06.049648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca48061-480c-45ce-ae1e-1464e3712f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.051110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca48061-480c-45ce-ae1e-1464e3712f6a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-9ca48061-480c-45ce-ae1e-1464e3712f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:06.065589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:06.066531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:06.067417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:06.067417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:06.067417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:06.067417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:06.067417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 281/566] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:06.072542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00215e-5cc9-49a2-aec5-4070163b1694 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.072542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00215e-5cc9-49a2-aec5-4070163b1694 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.072542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00215e-5cc9-49a2-aec5-4070163b1694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.085448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0f00215e-5cc9-49a2-aec5-4070163b1694 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:06.086673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0f00215e-5cc9-49a2-aec5-4070163b1694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:06.121911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 286/567] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:06.122806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0f47b-6b83-4c4b-b813-2d40f94fea5f None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.140608 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.146191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.154226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 282/568] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:06.155419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00215e-5cc9-49a2-aec5-4070163b1694 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.223156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed0f47b-6b83-4c4b-b813-2d40f94fea5f None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.255677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00215e-5cc9-49a2-aec5-4070163b1694 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.257750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.258397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.258699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.258972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.259655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:06.259959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.261369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.272748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 287/569] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:06.273555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.288979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.289640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.289954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.290232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.300798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.302277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:06.317240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:06.318270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:06.319142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:06.319142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:06.319142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:06.319142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:06.319142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 283/570] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:06.319423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.364500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.381064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.405219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c27e194-35bc-4cd7-a3a7-e820cbeedeec None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.417774 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de060183-d92d-40d2-9ae5-6fbc814f5a89 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.441432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.442080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.442359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.442628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.443301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:06.443605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.445003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.450871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.451505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.451781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.452053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.456322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 288/571] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:06.457097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.466987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:06.472989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:06.474120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 284/572] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:06.475091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.558765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1da0b-50da-4f2a-ab97-b4af155eef3a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.588637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f29c30-5f82-4385-90f4-64086ced9bc3 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.591533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.592170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.592453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.592732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.594595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.595305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.603849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:06.608895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:06.609888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:06.610716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 289/573] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:06.611982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.623091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.623735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.624016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.624291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.631194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.632621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:06.643657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:06.644570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:06.645438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 285/574] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:06.645948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.714220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448fe8b9-ab02-4176-81a4-12fe3e941d3c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.746673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd256b5d-94da-46ad-94e6-cc04dbea7a5f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.748160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.748769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.749045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.749313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.750027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:06.750328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.751678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.762740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 290/575] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:06.763515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.785579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.786251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.786530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.786802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.793494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.794942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:06.806662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:06.807707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:06.808837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:06.812505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 286/576] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:06.813193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.818417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.840289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:06.864700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcc5ab6-19c2-42e1-b241-8b9f461b310c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.899157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.899768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.900042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.900310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.901004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:06.901303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.902681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.911041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 291/577] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:06.911803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:06.911914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ac295-803e-4fdb-8181-2f8cf60c8cc6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:06.945479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:06.946220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:06.946498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:06.946766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:06.947477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:06.947780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:06.949130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:06.957557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 287/578] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:06.958388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.008248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf1483-1a4a-4ff0-aaa8-b9cb3892645b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.023574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.041370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.042007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.042287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.042561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.043296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:07.043604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.044531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.045076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.056387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca59338-b254-441a-895e-ae0282985669 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.071291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 292/579] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:07.071291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.089941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.090573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.090845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.091113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] PATH_INFO: `/v3/users/glance` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.099018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.100636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:07.112810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:07.113884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 288/580] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:07.114880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.170026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05711c1-7c0f-40f5-9eb3-8f96fc376052 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.202133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.202744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.203024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.203290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.204019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:07.204320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.205795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.214457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf25a5-1a59-4181-bac0-9be18aac106e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.217153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 293/581] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:07.217899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.250861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.251497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.251857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.252132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.253147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.262654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.264091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.272023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:07.278525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:07.280894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:07.281941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:07.281941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:07.281941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:07.281941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:07.281941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 289/582] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:07.281941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.375781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76325f3-08c4-4de2-a629-5f2dbbe6c756 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.409081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.409705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.410009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.410282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.419786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.421226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:07.435865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:07.436903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:07.438118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:07.438118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:07.438118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:07.438118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:07.438118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 294/583] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:07.438118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.445057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb750b3-f943-46c3-b38b-5f14a208ccf1 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.478465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.479120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.479394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.479660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/4e107a27b86243dcbb160a3960682b2d/roles/fde07f9dcebb4680a98ab1f9c8d97c2a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.493969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=4e107a27b86243dcbb160a3960682b2d, role_id=fde07f9dcebb4680a98ab1f9c8d97c2a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.495387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.528539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.540708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35caa2fa-89b5-49b4-b325-1b1dcd8770cf None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.573173 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.573798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.574089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.574363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.575149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:07.575458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.576882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.593674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 295/584] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:07.594492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.616404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 290/585] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:07 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/4e107a27b86243dcbb160a3960682b2d/roles/fde07f9dcebb4680a98ab1f9c8d97c2a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:07.620971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.676319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.706832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b84ea5-a81d-499f-b2b0-424f4f2236b7 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.731099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb80f5-910a-422a-ad63-2f4dc326f334 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.751772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.753184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.753544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.753927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.755808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:07.756202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.757894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.767415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 296/586] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/role_assignments?user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:07.767415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.773733 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.774505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.774794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.775061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.775764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:07.776065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.777473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.786492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.793837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 291/587] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:07.795635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.901285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828639ee-f5c8-4644-92b5-ea9107798d9d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.925269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683539c0-94d3-497b-884f-ebfc3990c436 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:07.937154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:07.941044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.941744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.942123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.942742 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.943210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:07.943517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.944894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:07.959901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 297/588] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:07.960755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:07.973427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:07.974189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:07.974516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:07.974798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:07.987342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:07.988998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:08.006769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:08.007710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:08.008581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:08.008581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:08.008581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:08.008581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:08.012938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 292/589] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:08.013961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.033463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:08.065062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bae21-20d7-4724-ab09-acabfe2b8f70 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.102785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.103541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.103893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.104221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.114380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.116088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:08.129127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:08.130432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:08.131547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:08.135852 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc48012-0de7-4bd3-befd-e176983632aa None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.136885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 298/590] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:08.137850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.176110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.177067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.177559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.178063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.190707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.192841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:08.210387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:08.211371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:05:08.212299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:08.218149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 293/591] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:08.219777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.246151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:08.261141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65718f3e-8744-495a-8d80-edfbe3534892 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.292824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:08.302775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.303482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.303833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.304174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.305844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:08.306223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.310493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.329405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 299/592] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:08.329405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.338509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d7db-a8a9-4845-bb95-55b8b1694ace None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.384850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.386102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.386548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.386968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.388029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:08.388863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.391489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.415588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 294/593] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:08.416841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.441151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fe367b-1e0a-4b91-a38b-9227961bf96e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.483051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.484128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.484693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.485148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.487361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:08.487861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.490039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.518439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 300/594] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:08.519765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.520239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:08.545188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4fc23-9f0f-4dae-8ac2-5699bdd34ffb None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.584033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:08.585004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.585833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.586256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.586671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.594080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.597431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:08.608138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:08.609173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:08.610365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:08.612478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 295/595] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:08.613456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.654466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e245bb0-0217-4d70-8743-7f4fef5272d1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.704607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.706405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.707350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.707828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.721924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.724550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.726396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7991607-0d23-4f49-a182-31f2bf406888 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:08.744502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:08.745435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:08.746372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:08.746372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:08.746372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:08.746372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:08.750087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 301/596] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:08.751178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.770764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.771474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.771752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.772024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.783649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:08.786194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.787789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:08.803155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:08.804188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:08.805188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:08.805188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:08.805188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:08.805188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:08.808996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 296/597] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:08.809861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.886785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:08.893807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1866b4f-bb5f-4590-a098-cdd64d02c1b8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.931701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.932327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.932607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.932884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.933636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:08.933949 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef62e8d-5523-4765-84f2-da1187482aa2 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:08.934088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.935394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:08.952860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 302/598] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:08.952860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:08.984956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:08.986116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:08.986550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:08.987257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:08.988516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:08.989265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:08.991455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.009488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 297/599] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:09.010763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:09.070707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed601955-045c-4269-b263-975f58d07bb1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:09.076550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:09.116144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:09.116830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.117113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.117391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.118273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:09.118580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:09.120074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.134265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 303/600] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:09.135097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:09.136987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f6ae8e-3088-47fd-a463-298d3f2914e4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:09.158578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:09.183648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:09.184440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.184799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.185179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/9d4eba8e853c41bcbd92d6cab54efd0e/roles/fde07f9dcebb4680a98ab1f9c8d97c2a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.204537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=9d4eba8e853c41bcbd92d6cab54efd0e, role_id=fde07f9dcebb4680a98ab1f9c8d97c2a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:09.206386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.246334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7b5de-7720-4be8-a490-17ddcbf15f66 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:09.283853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:09.284515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.284774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.285050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.292643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:09.299824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.300143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 298/601] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:09 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/9d4eba8e853c41bcbd92d6cab54efd0e/roles/fde07f9dcebb4680a98ab1f9c8d97c2a => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:09.302579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:09.321224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:09.322456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:09.323549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:09.329939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 304/602] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:09.337831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:09.489694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:09.514084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c55c2ce-47b7-446d-91c4-1a7cd3ef8f19 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:09.516898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:09.524128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3352b5-b342-42fa-b3e0-9d8286dae7b7 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:09.564541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:09.565306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.565653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.566035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.574969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:09.576728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.576836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:09.577557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.577958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.578315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.579129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:09.579610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:09.581483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:09.592988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:09.593904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:09.594784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:09.597784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 299/604] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:09.598068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 305/604] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:09.609797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:09.609942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:09.760925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfe1ce8-2b77-477f-bfda-91b6f24a024c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:09.768597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d54761-75ca-46b0-9b14-9a63e7e69233 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:09.795743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5921b1ee-babb-45ed-9bcf-ba0c88fc30c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:09.796424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b1ee-babb-45ed-9bcf-ba0c88fc30c2 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.796704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b1ee-babb-45ed-9bcf-ba0c88fc30c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.796982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5921b1ee-babb-45ed-9bcf-ba0c88fc30c2 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/0d75852e9db24464bd69c0c19b75ab39/roles/fde07f9dcebb4680a98ab1f9c8d97c2a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.810124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:09.812580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8a43d8-ab6f-458f-8bb4-fff08509f2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:09.813204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a43d8-ab6f-458f-8bb4-fff08509f2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.813322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921b1ee-babb-45ed-9bcf-ba0c88fc30c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=0d75852e9db24464bd69c0c19b75ab39, role_id=fde07f9dcebb4680a98ab1f9c8d97c2a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:09.813481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a43d8-ab6f-458f-8bb4-fff08509f2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.813779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8a43d8-ab6f-458f-8bb4-fff08509f2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.814562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a43d8-ab6f-458f-8bb4-fff08509f2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:09.814868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a43d8-ab6f-458f-8bb4-fff08509f2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:09.815335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5921b1ee-babb-45ed-9bcf-ba0c88fc30c2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.816273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8a43d8-ab6f-458f-8bb4-fff08509f2b4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:09.829250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 300/605] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:09.831285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816f3d-8fba-4f14-aa4f-8ec50a8a144c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.831617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816f3d-8fba-4f14-aa4f-8ec50a8a144c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.831897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49816f3d-8fba-4f14-aa4f-8ec50a8a144c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.833385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 301/606] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:09.838426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816f3d-8fba-4f14-aa4f-8ec50a8a144c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:09.865310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:09.906550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 306/607] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:09 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/0d75852e9db24464bd69c0c19b75ab39/roles/fde07f9dcebb4680a98ab1f9c8d97c2a => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:09.908422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68f95-b998-4f5e-bcfd-1298b4bf8ee3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:09.908734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68f95-b998-4f5e-bcfd-1298b4bf8ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:09.909061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a68f95-b998-4f5e-bcfd-1298b4bf8ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:09.932436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-90a68f95-b998-4f5e-bcfd-1298b4bf8ee3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:09.933831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-90a68f95-b998-4f5e-bcfd-1298b4bf8ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:09.985338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49816f3d-8fba-4f14-aa4f-8ec50a8a144c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:10.019328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 307/608] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:10.020769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8146-9acb-4995-966b-41331605fb64 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.021118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8146-9acb-4995-966b-41331605fb64 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.021465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d8146-9acb-4995-966b-41331605fb64 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.023256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 308/609] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:10.040517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:10.042865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784556-25f7-46b8-9784-c71b8dec2a25 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.043149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784556-25f7-46b8-9784-c71b8dec2a25 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.043422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3784556-25f7-46b8-9784-c71b8dec2a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.048942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.049234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.049486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/052da4ed2e054c70ba8b0bf9b6c5656a/roles/fde07f9dcebb4680a98ab1f9c8d97c2a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.064773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e3784556-25f7-46b8-9784-c71b8dec2a25 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:10.066018 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e3784556-25f7-46b8-9784-c71b8dec2a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:10.066136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=052da4ed2e054c70ba8b0bf9b6c5656a, role_id=fde07f9dcebb4680a98ab1f9c8d97c2a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:10.067854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:10.138932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 309/610] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:10.139830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3784556-25f7-46b8-9784-c71b8dec2a25 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:10.143024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 302/611] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:09 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/052da4ed2e054c70ba8b0bf9b6c5656a/roles/fde07f9dcebb4680a98ab1f9c8d97c2a => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:10.164193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:10.213696 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:10.246334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:10.280975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a3577-a23e-4b69-8ca9-176c01d4e058 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:10.286106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3784556-25f7-46b8-9784-c71b8dec2a25 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:10.354649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:10.355318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.355694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.355980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.369743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:10.370463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.370743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.371013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.383307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:10.389641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:10.390640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:10.391867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 310/612] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:10.399394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:10.400181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:10.406154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:10.407077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:10.408023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:10.410758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 303/613] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:10.416871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:10.526232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1647a1da-3603-4676-b63b-fe00ca47349c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:10.544298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:10.579067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:10.580078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.580553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.581043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.582105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:10.582610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:10.584187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:10.601043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 311/614] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:10.603716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb08345-1191-49ff-861b-77a74ff0b719 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:10.606933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:10.638341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:10.650677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:10.651504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.651956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.652375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.653235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:10.653686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:10.656566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:10.674811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 304/615] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:10.685210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:10.811952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff545a09-6740-4027-948c-e612cf6073d5 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:10.847728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:10.848741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.849195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.849610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:10.860620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:10.862918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:10.869681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc018c2-3e4c-4478-81a3-45375fd08579 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:10.878457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:10.879346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:10.880241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:10.880241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:10.880241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:10.880241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:10.883243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 305/616] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:10.892920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:10.950110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:10.968543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:10.969170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:10.969461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:10.969740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.001874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.003463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.007587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bb8778-90cf-42ce-b896-48b31e31827e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:11.037325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:11.038328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:11.039226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:11.039226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:11.039226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:11.039226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:11.042977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 312/617] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 436 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:11.047786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.049075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:11.049506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.050041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.050527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.051413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:11.051914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.053488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.068307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 306/618] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:11.078719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:11.089521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:11.173229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d9caa-f675-4366-bb85-7e2bbc94b366 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.218905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.219875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.221091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.221507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.222372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:11.222819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.224337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.250590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 313/619] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:11.258895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:11.344509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de2e16-3f4d-41e4-a659-cebe79065f4a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.358357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:11.386205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.386848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.387123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.387392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.395167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.396611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.401396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:11.413334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:11.416753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:11.417711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 307/620] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:11.422698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:11.446624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ac08e2-fa16-4ce0-a845-e7b3c4fbf230 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.498421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.499441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.499962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.500375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.509304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.511260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:11.523083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:11.524235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:11.525426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:11.527633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 314/621] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:11.534699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:11.621121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510436ef-fced-4670-9dcd-82546688d6a2 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.643282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c908c5-4f3a-46ee-81f7-3f5a006e0302 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.671797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.672522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.672789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.673241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.674093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:11.674395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.675943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.690243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.691204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.691724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.692188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.694520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:11.695048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.696653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.715499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 308/622] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:11.730209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 315/623] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:11.735451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:11.737290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:11.744144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:11.770177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:11.870166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75372b8b-3604-4fc2-9efe-39d75fc373d5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.870741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0f42f8-cbfc-43f9-b119-c4c4392a000d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:11.908973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac05ebb8-d2ea-4a41-b65c-b7d616f6b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.910085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ebb8-d2ea-4a41-b65c-b7d616f6b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.910530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ebb8-d2ea-4a41-b65c-b7d616f6b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.911176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac05ebb8-d2ea-4a41-b65c-b7d616f6b1a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.916799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266e690-5e0d-4cd5-b970-92be347a7f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:11.917317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e690-5e0d-4cd5-b970-92be347a7f55 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.917690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e690-5e0d-4cd5-b970-92be347a7f55 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.918077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266e690-5e0d-4cd5-b970-92be347a7f55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.930308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266e690-5e0d-4cd5-b970-92be347a7f55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:11.932941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266e690-5e0d-4cd5-b970-92be347a7f55 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-a266e690-5e0d-4cd5-b970-92be347a7f55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:11.948874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:11.949866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:11.950752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:11.950752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:11.950752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:11.950752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:11.955233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 309/624] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:11.956606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911e25-8b20-428b-8493-de25d6805db2 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:11.956956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911e25-8b20-428b-8493-de25d6805db2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:11.957295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba911e25-8b20-428b-8493-de25d6805db2 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:11.959089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 310/625] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:11.959926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911e25-8b20-428b-8493-de25d6805db2 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.007629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05ebb8-d2ea-4a41-b65c-b7d616f6b1a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.009275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac05ebb8-d2ea-4a41-b65c-b7d616f6b1a2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.011706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.062476 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.094495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba911e25-8b20-428b-8493-de25d6805db2 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.124897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 316/626] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:12.126836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176d12c-9e81-4aa0-93c2-9571a597a145 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.127374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176d12c-9e81-4aa0-93c2-9571a597a145 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.127840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176d12c-9e81-4aa0-93c2-9571a597a145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.140100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.140721 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.140989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.141260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.143031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:12.143339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.144991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.148662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-f176d12c-9e81-4aa0-93c2-9571a597a145 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:12.150125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f176d12c-9e81-4aa0-93c2-9571a597a145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:12.163463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 311/627] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:12.163463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.229747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 317/628] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:12.231128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176d12c-9e81-4aa0-93c2-9571a597a145 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.263971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.288350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976c5d6-c77e-4d9a-8fb1-2b3f09975b58 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.322528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da20e84-4b72-47ef-af18-770ad11c2eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.323160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da20e84-4b72-47ef-af18-770ad11c2eca None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.323435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da20e84-4b72-47ef-af18-770ad11c2eca None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.323705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da20e84-4b72-47ef-af18-770ad11c2eca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.326540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.335518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da20e84-4b72-47ef-af18-770ad11c2eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.336984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da20e84-4b72-47ef-af18-770ad11c2eca None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.340758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176d12c-9e81-4aa0-93c2-9571a597a145 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-0da20e84-4b72-47ef-af18-770ad11c2eca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:12.354892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:12.356411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:12.357460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:12.357460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:12.357460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:12.357460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:12.360926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 312/629] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:12.362260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95648e-22bc-48ec-b407-7afcb57399db None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.362539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95648e-22bc-48ec-b407-7afcb57399db None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.362811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f95648e-22bc-48ec-b407-7afcb57399db None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.364077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 313/630] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:12.364759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95648e-22bc-48ec-b407-7afcb57399db None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.385297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.385974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.386256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.386529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.394509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.395887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:12.410517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:12.412038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:12.412944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 318/631] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:12.413426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.468559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f95648e-22bc-48ec-b407-7afcb57399db None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.500662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a7eceb-c041-42e5-b371-d8cd84581197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.501295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7eceb-c041-42e5-b371-d8cd84581197 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.502110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7eceb-c041-42e5-b371-d8cd84581197 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.502381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a7eceb-c041-42e5-b371-d8cd84581197 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.504252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.512663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e007c0d7-3295-43f4-ae19-b8bab2f0a674 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.512925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a7eceb-c041-42e5-b371-d8cd84581197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c9a7eceb-c041-42e5-b371-d8cd84581197 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:12.518851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:12.519823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:12.520895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 314/632] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:12.521730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd547c-5e45-48d8-af48-afdd22d62fcf None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.521831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd547c-5e45-48d8-af48-afdd22d62fcf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.522239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bd547c-5e45-48d8-af48-afdd22d62fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-57bd547c-5e45-48d8-af48-afdd22d62fcf None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:12.540661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-57bd547c-5e45-48d8-af48-afdd22d62fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:12.548048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723495e6-3f8f-4a1d-995b-3a5c781c706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.548697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723495e6-3f8f-4a1d-995b-3a5c781c706d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.548981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723495e6-3f8f-4a1d-995b-3a5c781c706d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.549255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723495e6-3f8f-4a1d-995b-3a5c781c706d None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.549977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723495e6-3f8f-4a1d-995b-3a5c781c706d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:12.550278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723495e6-3f8f-4a1d-995b-3a5c781c706d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.551647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723495e6-3f8f-4a1d-995b-3a5c781c706d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.562506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 319/633] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:12.563744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1782a0b-01bb-498f-b2cf-e452c10c0203 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.564665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1782a0b-01bb-498f-b2cf-e452c10c0203 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.564848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1782a0b-01bb-498f-b2cf-e452c10c0203 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.566089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 320/634] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:12.566784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1782a0b-01bb-498f-b2cf-e452c10c0203 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.594078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.616280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 315/635] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:12.617087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd547c-5e45-48d8-af48-afdd22d62fcf None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.676627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1782a0b-01bb-498f-b2cf-e452c10c0203 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.709395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.710056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.710324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.710600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.711334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:12.711640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.713106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.714485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bd547c-5e45-48d8-af48-afdd22d62fcf None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.724686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 321/636] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:12.725483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.743629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.747191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb80f0-1a95-45b0-b569-35b40134fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.747795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb80f0-1a95-45b0-b569-35b40134fc9f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.748076 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb80f0-1a95-45b0-b569-35b40134fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.748350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb80f0-1a95-45b0-b569-35b40134fc9f None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.749061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb80f0-1a95-45b0-b569-35b40134fc9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:12.749363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb80f0-1a95-45b0-b569-35b40134fc9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.750849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb80f0-1a95-45b0-b569-35b40134fc9f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.759151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 316/637] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:12.760368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14958f0c-0f5a-4d1b-a293-ce69299fdaeb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.760722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14958f0c-0f5a-4d1b-a293-ce69299fdaeb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.761050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14958f0c-0f5a-4d1b-a293-ce69299fdaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.778131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-14958f0c-0f5a-4d1b-a293-ce69299fdaeb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:12.779381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-14958f0c-0f5a-4d1b-a293-ce69299fdaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:12.825778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b27bd0b-f9d2-44de-8b3e-94a510931217 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.843981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 317/638] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:12.844889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14958f0c-0f5a-4d1b-a293-ce69299fdaeb None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.858326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.859234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.859656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.860127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.866781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:12.868219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:12.879167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:12.880282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:12.881437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:12.884810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 322/639] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:12.885548 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:12.940200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14958f0c-0f5a-4d1b-a293-ce69299fdaeb None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.954459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.975573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:12.976151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:12.976432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:12.976706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:12.980506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3bd223-bfd8-45a8-8cc4-91a33dd52ecb None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:12.983748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:12.986869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:12.991832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:12.992945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:12.993837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 318/640] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:12.994891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.020563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.049118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.049118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.049118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/e70a3ed5aa5441fb9e8d4ed8f071bcc0/roles/fde07f9dcebb4680a98ab1f9c8d97c2a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.049511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:13.099330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b6baa-9b02-4977-be48-6f47dfa2115e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.138561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.139209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.139487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.139761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.151060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.152092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=e70a3ed5aa5441fb9e8d4ed8f071bcc0, role_id=fde07f9dcebb4680a98ab1f9c8d97c2a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.152503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.153505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:13.167280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:13.168449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:13.169797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:13.169797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:13.169797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:13.169797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:13.169797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 319/641] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:13.169797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.248850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:13.261159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 323/642] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:12 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/e70a3ed5aa5441fb9e8d4ed8f071bcc0/roles/fde07f9dcebb4680a98ab1f9c8d97c2a => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:13.262054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.268227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36424bdd-65be-4d74-a46e-7a8b9185d80e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.316681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.317828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.318114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.318542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.333965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:13.339567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:13.340603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:13.341508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 320/643] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:13.343094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.390717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f45cfe-62c6-403a-a8c1-28b8b5f81ee2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.426859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:13.442808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.443439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.443720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.443995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.444973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:13.445315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.447191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.461222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 324/644] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:13.465809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.474322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7aec42-4659-47c7-8b2d-f988a8506b88 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.510524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.511212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.511494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.511766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.512480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:13.512781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.514172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.524098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 321/645] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:13.528844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.529347 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:13.575181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0fa50-239c-4904-b3e8-bf6c66121d58 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.612137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.613116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.613612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.614100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.614866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:13.615175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.616546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.629700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 325/646] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:13.630543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.641276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c9136-53fe-49e1-8f99-1b40e0692b00 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.674726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:13.678526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.679153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.679435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.679709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.680422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:13.680726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.682121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.691045 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 322/647] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:13.693548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.742843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494eab71-eabc-4737-995f-dee0fe0d4eba None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.773858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:13.778210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.778733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.779876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.779876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.780296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=4e107a27b86243dcbb160a3960682b2d) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:13.780604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.782037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.794030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 326/648] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/role_assignments?user.id=4e107a27b86243dcbb160a3960682b2d&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:13.794030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.828032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a05aaa-76c7-4707-bff9-3ba69d5c0b41 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.866859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.867618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.868002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.868399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.884083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.885759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:13.902620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:13.903783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:13.904941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:13.904941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:13.904941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:13.904941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:13.904941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 323/649] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:13.905283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:13.925542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb50b6-d0df-4bdd-9d05-6929d10975d4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:13.935257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:13.973392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ffa65-f90d-4562-a397-396831129843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:13.974071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ffa65-f90d-4562-a397-396831129843 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:13.974353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ffa65-f90d-4562-a397-396831129843 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:13.974785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780ffa65-f90d-4562-a397-396831129843 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:13.982785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ffa65-f90d-4562-a397-396831129843 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:13.984345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780ffa65-f90d-4562-a397-396831129843 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-780ffa65-f90d-4562-a397-396831129843 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:13.998610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:13.999650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 27 18:05:14.000614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:14.003823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 327/650] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:14.004885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ffa65-f90d-4562-a397-396831129843 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.042316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f5f8a8-1995-45ab-800c-ce0590e0044d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.067158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.091615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.092352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.092637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.092913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.107957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.112185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.132875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780ffa65-f90d-4562-a397-396831129843 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:14.135662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:14.136541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:14.137842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:14.137842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:14.137842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:14.137842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:14.137842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 324/651] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:14.138135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.170013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.170629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.170905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.171173 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.171855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:14.172151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.173531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.185695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 328/652] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:14.190629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.218649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.255618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c622400-2042-4de4-86be-cdd5ab026cfd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.291653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eeb28a-39bf-43ae-9b22-17851674d688 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.293124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.293693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.294023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.294301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.295239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:14.295562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.296992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.317009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 325/653] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:14.318053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.327540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.328248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.328604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.328959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.330279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:14.330652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.332083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.345857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 329/654] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:14.346718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.350428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.435683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68208dfc-4838-4c6f-af00-815da523b64a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.440261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.455614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80552555-04b7-415a-b502-7a36d82ab89e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.481670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.483551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.483986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.484429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.493505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.493978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.494369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.494744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.495135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.496189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:14.511756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:14.512947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:14.514150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:14.517647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 326/655] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:14.518619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.577730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.578830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.641002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38279c86-71ca-445b-aa7b-0031e897fd98 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.666249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.676648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.677599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.680105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.680105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.682104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.686938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 330/656] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:14.687805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.690329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.693028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:14.706427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:14.707396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 27 18:05:14.708343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:14.715449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 327/657] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:14.716822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.790434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e394e95-889b-4c54-8949-cda599678b03 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.824951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.825569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.825839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01a18ec-7ad6-407a-aa03-c3cf8acb15a9 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.825961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.826307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.827098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:14.827403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.828890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.851678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 331/658] 10.222.0.67 () {56 vars in 1137 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:14.851678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.874066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.875066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.875597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:14.876082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:14.888365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:14.890306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:14.901384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:14.907838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:14.909505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:14.914908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:14.914908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:14.914908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:14.914908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:14.915517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 328/659] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:14.916325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:14.917953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:14.963661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fb5530-91c6-4666-8f15-00bf036af369 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:14.998247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:14.999273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:14.999676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.000039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.001055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:15.001969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.003609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.027262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 332/660] 10.222.0.67 () {56 vars in 1139 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:15.028249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.049272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5b0a73-a1f7-42c6-a2dd-529408ff8775 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.100772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:15.105039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.105346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.105613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.136868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b036b-caef-441f-98d7-083a54bcc0e0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.138892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.175633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:15.176389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.176531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.176815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.177885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:15.178842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.180353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.203593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 333/661] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:15.203593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.205251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.207250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.208744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.313305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 329/662] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:15.314146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.348084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bd064c-330c-484b-8beb-fe9a124a3e79 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.384019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84f956b-14f5-44a0-8b98-a77f4e5f814a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:15.385075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f956b-14f5-44a0-8b98-a77f4e5f814a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.385655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f956b-14f5-44a0-8b98-a77f4e5f814a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.386070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84f956b-14f5-44a0-8b98-a77f4e5f814a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.418521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.419705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.422580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bade27-3039-45f7-a031-ad513ebdc579 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.457939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f956b-14f5-44a0-8b98-a77f4e5f814a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.459528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84f956b-14f5-44a0-8b98-a77f4e5f814a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.460961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:15.461619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.461935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.462915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.469366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.471390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:15.483327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:15.484851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 330/663] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:15.486310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.573466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 334/664] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:15.573466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6dc7f-e906-47f6-a789-774ad777d8f2 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.573466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6dc7f-e906-47f6-a789-774ad777d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.573466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6dc7f-e906-47f6-a789-774ad777d8f2 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.574259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 335/665] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:15.574521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6dc7f-e906-47f6-a789-774ad777d8f2 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.596145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff65736-e2a8-46c6-9f8c-e45b50a71ba0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.632820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:15.633724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.634087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.634301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.645397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.646687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.647988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:15.663524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:15.666801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:15.667677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:15.667677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:15.667677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:15.667677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:15.669385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 331/666] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:15.670261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.685592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.688334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6dc7f-e906-47f6-a789-774ad777d8f2 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.723285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9550e367-5572-41a2-bddb-aa4ca251efba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:15.723914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e367-5572-41a2-bddb-aa4ca251efba None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.724193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e367-5572-41a2-bddb-aa4ca251efba None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.724466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9550e367-5572-41a2-bddb-aa4ca251efba None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.725208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550e367-5572-41a2-bddb-aa4ca251efba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:15.725522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550e367-5572-41a2-bddb-aa4ca251efba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.727091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9550e367-5572-41a2-bddb-aa4ca251efba None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.739292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 336/667] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:15.740450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1042-a602-4d6f-ad45-ea2d8addf6f9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.740732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1042-a602-4d6f-ad45-ea2d8addf6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.741005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb1042-a602-4d6f-ad45-ea2d8addf6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.758785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ccbb1042-a602-4d6f-ad45-ea2d8addf6f9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:15.760025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ccbb1042-a602-4d6f-ad45-ea2d8addf6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:15.781033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e93a16-58d7-4c7a-9428-19659deeb1df None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.817824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:15.818468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:15.818744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:15.819212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:15.829030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 337/668] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:15.830429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb1042-a602-4d6f-ad45-ea2d8addf6f9 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.834611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:15.836044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:15.856956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:15.857913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:15.858809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:15.858809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:15.858809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:15.858809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:15.860416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 332/669] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:15.861916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:15.909966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.945667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:15.961245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb1042-a602-4d6f-ad45-ea2d8addf6f9 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:15.999519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.000506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.000927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.001618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.002480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:16.002928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.003511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8401e8-05e7-4a2d-b5d6-1f0fbc3d0ba7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.004619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.023184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 338/670] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:16.024050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.047638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.048439 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.048780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.049151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.050025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=9d4eba8e853c41bcbd92d6cab54efd0e) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:16.050400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.051897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.058270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 333/671] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:15 2022] GET /identity/v3/role_assignments?user.id=9d4eba8e853c41bcbd92d6cab54efd0e&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:16.058932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.148146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da8ebdd-38f2-43b1-8629-f480292939e7 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.163683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:16.188149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d7c4e7-8d93-40a3-b8c1-cc50c52284f4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.189582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448532eb-a414-4aee-9aac-f5d035c97a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.190473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448532eb-a414-4aee-9aac-f5d035c97a57 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.192309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448532eb-a414-4aee-9aac-f5d035c97a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.192748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448532eb-a414-4aee-9aac-f5d035c97a57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.213809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448532eb-a414-4aee-9aac-f5d035c97a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-448532eb-a414-4aee-9aac-f5d035c97a57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:16.221193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:16.222252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:16.223229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:16.225215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 339/672] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:16.225906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea352-d43e-4d4f-8407-8e33e96c3ce1 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.226187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea352-d43e-4d4f-8407-8e33e96c3ce1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.226463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ea352-d43e-4d4f-8407-8e33e96c3ce1 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.227737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 340/673] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:16.228418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea352-d43e-4d4f-8407-8e33e96c3ce1 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.240889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:16.253878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.255362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.255643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.255912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.256611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:16.256910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.258461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.273563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 334/674] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:16.274292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.362947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ea352-d43e-4d4f-8407-8e33e96c3ce1 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.398765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85cf79-fcaf-4566-bfab-4b7ebe286a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.399404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85cf79-fcaf-4566-bfab-4b7ebe286a9c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.399683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85cf79-fcaf-4566-bfab-4b7ebe286a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.399957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85cf79-fcaf-4566-bfab-4b7ebe286a9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.401388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb25f-abca-4d61-adb9-a12161f8064f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.406973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85cf79-fcaf-4566-bfab-4b7ebe286a9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.408939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85cf79-fcaf-4566-bfab-4b7ebe286a9c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-9d85cf79-fcaf-4566-bfab-4b7ebe286a9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:16.420227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:16.421115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:16.422047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 341/675] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:16.423021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67bec-564c-4b3e-92d4-b6c51286d9bf None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.423021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67bec-564c-4b3e-92d4-b6c51286d9bf None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.423021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff67bec-564c-4b3e-92d4-b6c51286d9bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.440746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6ff67bec-564c-4b3e-92d4-b6c51286d9bf None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:16.441953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6ff67bec-564c-4b3e-92d4-b6c51286d9bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:16.449931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.450828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.451705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.452186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.453712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:16.454185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.456275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.467439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:16.470429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 335/676] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:16.471311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.514753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 342/677] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:16.518943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff67bec-564c-4b3e-92d4-b6c51286d9bf None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.523500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:16.580770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7106f9-6144-4f1c-9671-070435d2f753 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.622146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.622784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.623086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.623336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.629494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff67bec-564c-4b3e-92d4-b6c51286d9bf None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.630427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.632382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:16.644284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:16.645213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:16.646132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 336/678] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:16.646610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.669371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.670028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.670366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.670588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.671334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:16.671644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.673100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.690105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 343/679] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:16.691219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.715869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:16.759867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2aa78-db72-459a-8158-5f2a8cadd523 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.771231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:16.793690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe81711-5764-4fc7-bfd0-1156ce78e024 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.795967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.796613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.796892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.797165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.808938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.810795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:16.825094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:16.826246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:16.827131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:16.827131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:16.827131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:16.827131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:16.827131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 337/680] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:16.830831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.832246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.832892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.833175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.833444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.844565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:16.849491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:16.850648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:16.851786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:16.855492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 344/681] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:16.856313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:16.941097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb45bfb-3e3b-4ecc-9529-1b67711ab629 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.944345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:16.963044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642ee034-5a31-4ec2-bb71-ac19b1af1a70 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:16.975707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:16.976323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:16.976599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:16.976884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:16.977627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:16.977981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:16.979406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:16.992413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 338/682] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:16.993456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.009044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.009689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.010007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.010541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.011060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=0d75852e9db24464bd69c0c19b75ab39) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:17.011370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.012790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.025792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 345/683] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/role_assignments?user.id=0d75852e9db24464bd69c0c19b75ab39&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:17.025792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.031001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:17.141912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4045901-4ab7-4bca-bc80-02b3fd791cbe None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.167289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f17e30-afe2-42fe-8fb4-b1d79cada657 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.182926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.183887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.184270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.184548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.185243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:17.185547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.187007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.204550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 339/684] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:17.205472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.215945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.216909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.217126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.217555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.218162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:17.218524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.220600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.232297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 346/685] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:17.233206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.247809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:17.316833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:17.345146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e420e53-9735-43c8-a36d-458fe009e847 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.360391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc167eb8-a9fe-4913-9910-7b97d7a046ce None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.384499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.385120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.385405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.385676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.386503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=052da4ed2e054c70ba8b0bf9b6c5656a) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:17.386817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.388246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.394814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 340/686] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/role_assignments?user.id=052da4ed2e054c70ba8b0bf9b6c5656a&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:17.395732 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.398948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.399948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.400442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.400916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.410429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.412319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:17.425410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:17.426420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:17.427392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:17.430165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 347/687] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:17.447179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.563252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd63405-3efc-434c-9fe8-b26a31d2ce0a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.587110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:17.617038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.617698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.618003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.618276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.632833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.635092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.642511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:17.646514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51925db4-d657-42f6-b2a9-7272b6d623dc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:17.653388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:17.654636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:17.655519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:17.655519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:17.655519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:17.655519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:17.657885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 341/688] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:17.663480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.688837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.690260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.690635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.691011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.692131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:17.692502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.694526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.717802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 348/689] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:17.724589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.785674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c982adba-52f2-4a9a-8784-865946996934 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.828040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.829364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.830015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.830403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.831209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:17.831617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.833526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:17.849141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bb171b-4cb8-472d-80ef-b5d46c8bddfa None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:17.849333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 342/690] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:17.853171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:17.882138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:17.892973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:17.894598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:17.895034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:17.895446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:17.947520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:17.970974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:17.973035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.042641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0537f88-f082-40bc-8c24-f3f99ae0e1fe None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:18.082295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 349/691] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 27 18:05:18.090897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.112636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:18.113289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.113577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.113896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.123649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:18.125091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:18.139701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:18.140750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:18.141722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 343/692] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:05:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:18.146254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.152580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:18.288749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46bc501-e0cd-4064-83d8-3c1ccf54bdd4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:18.319551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed0fd2-4e2b-4d35-b9bc-7930628631af None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:18.336434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9161af8-bf3a-4afc-a6e9-f899cbbf1b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:18.337327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9161af8-bf3a-4afc-a6e9-f899cbbf1b9c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.337613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9161af8-bf3a-4afc-a6e9-f899cbbf1b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.337937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9161af8-bf3a-4afc-a6e9-f899cbbf1b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.340336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:18.351936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9161af8-bf3a-4afc-a6e9-f899cbbf1b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:18.353729 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9161af8-bf3a-4afc-a6e9-f899cbbf1b9c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.360297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb5c09-7660-4623-9bb7-f8e7a1576d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:18.361755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5c09-7660-4623-9bb7-f8e7a1576d2e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.362230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5c09-7660-4623-9bb7-f8e7a1576d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.362767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb5c09-7660-4623-9bb7-f8e7a1576d2e None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.363738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb5c09-7660-4623-9bb7-f8e7a1576d2e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:18.364214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb5c09-7660-4623-9bb7-f8e7a1576d2e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:18.365964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bb5c09-7660-4623-9bb7-f8e7a1576d2e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-c9161af8-bf3a-4afc-a6e9-f899cbbf1b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:18.372237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:18.373123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:18.374030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:18.374030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:18.374030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:18.374030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:18.374030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 350/693] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:18.375043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc100-93e7-45a3-9d82-c159aab5579a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.375328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc100-93e7-45a3-9d82-c159aab5579a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.375603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5bc100-93e7-45a3-9d82-c159aab5579a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.377808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 351/694] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:18.379036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bc100-93e7-45a3-9d82-c159aab5579a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.392875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 344/695] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:18.394412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbd61-654c-4a92-aa40-bdb37357734d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.394759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbd61-654c-4a92-aa40-bdb37357734d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.395102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdbd61-654c-4a92-aa40-bdb37357734d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.415571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-94fdbd61-654c-4a92-aa40-bdb37357734d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:18.416812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-94fdbd61-654c-4a92-aa40-bdb37357734d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:18.479332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:18.493980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 345/696] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:18.495185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdbd61-654c-4a92-aa40-bdb37357734d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.505871 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5bc100-93e7-45a3-9d82-c159aab5579a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:18.550988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:18.551948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.552476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.552966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.553982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:18.554532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:18.556204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.568873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 352/697] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:18.570051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.627365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdbd61-654c-4a92-aa40-bdb37357734d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:18.634908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:18.664599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:18.665536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.665654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.666901 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.674748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9992165-e44e-4def-9aeb-dbd1afd5f5de None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:18.710207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:18.711231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.711684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.712125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.719114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:18.723657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:18.725299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:18.739982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:18.741120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:18.742265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:18.742265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:18.742265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:18.742265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:18.747856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 353/698] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:18.747856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.748627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:18.750322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.846784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679005a5-8443-4be3-9ff9-d377a5332a1b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:18.862316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 346/699] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:18.863635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.873706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:18.900359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:18.900359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:18.900359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:18.900359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:18.900763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:18.900763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:18.906616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:18.907539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:18.908414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 354/700] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:18.908897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:18.960154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:18.979819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1a8b9a-0ef2-4781-a3ae-6d4fb190efc5 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.010401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f352f4f-bccb-40ad-8791-722f5ad04b8d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.017831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.018686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.019234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.019715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.020597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:19.021157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.022843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.040950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 347/701] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:19.042248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.046648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.046934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.047212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.047483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.058959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.060358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:19.075352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:19.076255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:19.077174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:19.077174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:19.077174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:19.077174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:19.077174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 355/702] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:19.077640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.117236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:19.155867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13062f-6f2f-485f-ab9c-15d30145dabd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.179854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53953ef-be72-4911-82c5-61032a790f60 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.181366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:19.197239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.207590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.207590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.207590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.207590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:19.207590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.207590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.214444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 348/703] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:19.214864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.215486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.215762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.216034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.216383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.216758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.218375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.307577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 356/704] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:05:19 2022] POST /identity/v3/users => generated 254 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:19.308977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.326120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ae1b9-ac42-40f1-8cf1-e2ac04eead29 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.356038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:19.365605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613a1932-171f-4b68-98b5-208bdfb14725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.366413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1932-171f-4b68-98b5-208bdfb14725 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.366694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1932-171f-4b68-98b5-208bdfb14725 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.366965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613a1932-171f-4b68-98b5-208bdfb14725 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.367662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1932-171f-4b68-98b5-208bdfb14725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:19.367961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1932-171f-4b68-98b5-208bdfb14725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.369335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613a1932-171f-4b68-98b5-208bdfb14725 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.385457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 349/705] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:19.387148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390680-8972-4ce7-b522-aed869288ea4 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.387880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390680-8972-4ce7-b522-aed869288ea4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.388161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0390680-8972-4ce7-b522-aed869288ea4 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.389981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 350/706] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:19.397657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ffd9-9cb0-4ceb-8d12-dc74d1aa41ae None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.398009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ffd9-9cb0-4ceb-8d12-dc74d1aa41ae None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.398247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2013ffd9-9cb0-4ceb-8d12-dc74d1aa41ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.423560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-2013ffd9-9cb0-4ceb-8d12-dc74d1aa41ae None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:19.425110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2013ffd9-9cb0-4ceb-8d12-dc74d1aa41ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:19.484063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf4d3ff-e3a5-45e7-9ead-409f2226610e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.519945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 351/707] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:19.521130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ffd9-9cb0-4ceb-8d12-dc74d1aa41ae None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.532438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.533746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.534462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.534913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.536120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:19.538110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.540006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.548879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 357/708] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/role_assignments?user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:19.550274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.586594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:19.660373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2013ffd9-9cb0-4ceb-8d12-dc74d1aa41ae None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.687714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:19.706900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a8260-2c29-4d5b-97c3-1a54097e3fe0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.711464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.712374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.714707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.714707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.722821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.724622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:19.739275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:19.740288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:19.741200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:19.743650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 352/709] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:19.749039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.749749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.750040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.750154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.750323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.751036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.752476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:19.766279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:19.767840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:19.768723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 358/710] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:19.773954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.876689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3143ca49-687d-4cf1-a4b9-1ad3c61a8a32 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.888792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:19.905696 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c3e17-b3bb-43db-aa54-d5ecdfe9490d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:19.921173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7d83d-7dc6-46f5-aac5-5afe69c8fd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.922191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d83d-7dc6-46f5-aac5-5afe69c8fd3e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.922191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d83d-7dc6-46f5-aac5-5afe69c8fd3e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.922389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7d83d-7dc6-46f5-aac5-5afe69c8fd3e None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.923178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d83d-7dc6-46f5-aac5-5afe69c8fd3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:19.923781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d83d-7dc6-46f5-aac5-5afe69c8fd3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.924898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7d83d-7dc6-46f5-aac5-5afe69c8fd3e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.944651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 353/711] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:19.950340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c91da-6f7f-48bb-a883-0d836b740485 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.950340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c91da-6f7f-48bb-a883-0d836b740485 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.950340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c91da-6f7f-48bb-a883-0d836b740485 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.950340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 354/712] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:19.950340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c91da-6f7f-48bb-a883-0d836b740485 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:19.957179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafa13a-4eca-4b9e-8274-1ac4b89a004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:19.957862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafa13a-4eca-4b9e-8274-1ac4b89a004c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.958150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafa13a-4eca-4b9e-8274-1ac4b89a004c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.958425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafa13a-4eca-4b9e-8274-1ac4b89a004c None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.959170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafa13a-4eca-4b9e-8274-1ac4b89a004c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:19.959920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafa13a-4eca-4b9e-8274-1ac4b89a004c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:19.961322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafa13a-4eca-4b9e-8274-1ac4b89a004c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:19.968171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 359/713] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:19.969816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec96ea-0dd9-4e07-b7be-addb7145589b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:19.970273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec96ea-0dd9-4e07-b7be-addb7145589b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:19.970559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec96ea-0dd9-4e07-b7be-addb7145589b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:19.990495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:19.993334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a7ec96ea-0dd9-4e07-b7be-addb7145589b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:19.994587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a7ec96ea-0dd9-4e07-b7be-addb7145589b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:20.080768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c91da-6f7f-48bb-a883-0d836b740485 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:20.086663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 360/714] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:20.087630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec96ea-0dd9-4e07-b7be-addb7145589b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:20.131472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:20.132574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:20.133268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:20.133704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:20.135132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=4e107a27b86243dcbb160a3960682b2d) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:20.135823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:20.137644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:20.145987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 355/715] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:19 2022] GET /identity/v3/role_assignments?user.id=4e107a27b86243dcbb160a3960682b2d&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:20.147049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:20.225338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:20.265097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec96ea-0dd9-4e07-b7be-addb7145589b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:20.329798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:20.334734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c21fba6-9c59-4b9c-b76c-5d8684ad14d2 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:20.335237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:20.336320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:20.336995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:20.337467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:20.339142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:20.343156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:20.343156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:20.349048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 361/716] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 18:05:20 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:20.389495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:20.390625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:20.391102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:20.391597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] PATH_INFO: `/v3/services/network` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:20.392441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:20.394119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:20.406925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:20.408014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:20.408869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:20.411849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 356/717] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:20 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:20.425729 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:20.539050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792f996-0adc-4aa3-9fb0-d104390c4799 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:20.587671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a3d3b-7a6d-43cb-8468-2a271515a752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:20.588672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3d3b-7a6d-43cb-8468-2a271515a752 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:20.589158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3d3b-7a6d-43cb-8468-2a271515a752 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:20.589648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a3d3b-7a6d-43cb-8468-2a271515a752 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:20.590551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a3d3b-7a6d-43cb-8468-2a271515a752 None admin] RBAC: Adding query filter params (name=network) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:20.591133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a3d3b-7a6d-43cb-8468-2a271515a752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:20.592703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a3d3b-7a6d-43cb-8468-2a271515a752 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:20.598898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 362/718] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:20.604600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:20.712116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec0914b-b348-45fb-9bb8-fef819547b60 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:20.753376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f440-c76b-43ec-9a13-4217e18d911e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:20.754390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f440-c76b-43ec-9a13-4217e18d911e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:20.754848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f440-c76b-43ec-9a13-4217e18d911e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:20.755321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f440-c76b-43ec-9a13-4217e18d911e None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:20.756249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f440-c76b-43ec-9a13-4217e18d911e None admin] RBAC: Adding query filter params (type=network) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:20.756739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f440-c76b-43ec-9a13-4217e18d911e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:20.758308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f440-c76b-43ec-9a13-4217e18d911e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:20.768455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 357/719] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:21.815083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1092e7-b009-41c4-845f-242e2c2ca560 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:21.816090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1092e7-b009-41c4-845f-242e2c2ca560 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:21.816566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1092e7-b009-41c4-845f-242e2c2ca560 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:21.818407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 363/720] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:21.823175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5f15-c7b7-4417-8ff6-ee6cac177798 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:21.823982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5f15-c7b7-4417-8ff6-ee6cac177798 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:21.824481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe5f15-c7b7-4417-8ff6-ee6cac177798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:21.850693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8ffe5f15-c7b7-4417-8ff6-ee6cac177798 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:21.852207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8ffe5f15-c7b7-4417-8ff6-ee6cac177798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:21.880199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:21.941497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 358/721] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:21.983564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1092e7-b009-41c4-845f-242e2c2ca560 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:21.999616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:22.112883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1092e7-b009-41c4-845f-242e2c2ca560 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:22.160216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb2b46f-3c2d-4424-990c-577f783998fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:22.160860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2b46f-3c2d-4424-990c-577f783998fd None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.161134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2b46f-3c2d-4424-990c-577f783998fd None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.161403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb2b46f-3c2d-4424-990c-577f783998fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.178591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb2b46f-3c2d-4424-990c-577f783998fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-bfb2b46f-3c2d-4424-990c-577f783998fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:22.183505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:22.184421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:22.185258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:22.189272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 364/722] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:22.190472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe5f15-c7b7-4417-8ff6-ee6cac177798 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:22.219261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d31eb-8d4f-494b-b75e-93e06567acb9 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.219560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d31eb-8d4f-494b-b75e-93e06567acb9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.220347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d31eb-8d4f-494b-b75e-93e06567acb9 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.222012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 365/723] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:22.226929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3924-6371-439a-acf5-201bc8e31059 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.227213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3924-6371-439a-acf5-201bc8e31059 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.227493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3924-6371-439a-acf5-201bc8e31059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.256763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-778a3924-6371-439a-acf5-201bc8e31059 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:22.257988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-778a3924-6371-439a-acf5-201bc8e31059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:22.345112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:22.352361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 366/724] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 27 18:05:22.367286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe5f15-c7b7-4417-8ff6-ee6cac177798 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:22.394181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3924-6371-439a-acf5-201bc8e31059 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:22.443934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:22.444578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.444861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.445137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.445898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:22.446204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:22.447579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:22.465221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 359/725] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:22.483795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:22.525022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3924-6371-439a-acf5-201bc8e31059 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:22.541801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:22.566715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:22.567366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.567646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.567925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.591249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:22.601255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:22.602193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:22.603036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:22.606325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 367/726] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:22.610944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:22.694906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5d8930-b757-4116-af23-369fccc22ac6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:22.731564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:22.735286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:22.736204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.736728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.737221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.813174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af9c5ce-d1cf-426f-9c1d-768e1e211e7b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:22.851253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dd6bb1-ca5e-4eb2-9522-2b62b8b61c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:22.851891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6bb1-ca5e-4eb2-9522-2b62b8b61c25 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.852154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6bb1-ca5e-4eb2-9522-2b62b8b61c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.852420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dd6bb1-ca5e-4eb2-9522-2b62b8b61c25 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.853149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6bb1-ca5e-4eb2-9522-2b62b8b61c25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:22.853460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6bb1-ca5e-4eb2-9522-2b62b8b61c25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:22.854884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dd6bb1-ca5e-4eb2-9522-2b62b8b61c25 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:22.869899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 368/727] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:22.869899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f694-81c3-4cc6-bdff-9c53312191cc None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.869899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f694-81c3-4cc6-bdff-9c53312191cc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.869899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381f694-81c3-4cc6-bdff-9c53312191cc None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.869899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 369/728] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:22.869899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200abe8-422d-4185-8181-3af420b181c8 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.869899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200abe8-422d-4185-8181-3af420b181c8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.870485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200abe8-422d-4185-8181-3af420b181c8 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.872617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 370/729] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:22.874671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7510a-28c1-4692-bad5-db613874656d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.874671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7510a-28c1-4692-bad5-db613874656d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.875073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db7510a-28c1-4692-bad5-db613874656d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.879018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:22.881004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:22.894114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-1db7510a-28c1-4692-bad5-db613874656d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:22.895299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1db7510a-28c1-4692-bad5-db613874656d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:22.896024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:22.896871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:22.898399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:22.898399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:22.898399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:22.898399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:22.898399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 360/730] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 414 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:22.898399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:22.971372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 371/731] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:22.972997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274ad5-3266-434f-9fda-bcdf3f614732 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:22.973275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274ad5-3266-434f-9fda-bcdf3f614732 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:22.973543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb274ad5-3266-434f-9fda-bcdf3f614732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:22.990139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:22.997179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-eb274ad5-3266-434f-9fda-bcdf3f614732 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:23.008139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-eb274ad5-3266-434f-9fda-bcdf3f614732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:23.017286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc020d4-ca8e-43eb-9d0c-ff240ceea000 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.046254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:23.057532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.058430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.058541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.067656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.077832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 372/732] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:23.077832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb274ad5-3266-434f-9fda-bcdf3f614732 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.079298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.080950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:23.098451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:23.099393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:23.100266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:23.100266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:23.100266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:23.100266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:23.104287 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 361/733] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:23.105215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.187455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb274ad5-3266-434f-9fda-bcdf3f614732 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.208849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec1101-d2f2-4afa-a126-70c2814380b9 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.222775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.223443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.223727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.224021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.224690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:23.224994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.226569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.234158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:23.243708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 373/734] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:23.243708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.249928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.250581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.251373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.251649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.261872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:23.267390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:23.268463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 362/735] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:23.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.287614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:23.350806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b5b392-f0f5-4c55-934e-7ff453cedfa1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.381099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe91951-22a7-452f-9ca1-0abc34003d2f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.387272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.387897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.388172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.388441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.389124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.391182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.416091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.416702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.416982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.417255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.417970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:23.418277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.419698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.431245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 363/736] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:23.432025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.475741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:23.508199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 374/737] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:23 2022] POST /identity/v3/services => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:23.509071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.533775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377d588-6345-4128-8001-19e3816ab7b4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.589066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d289dfa-affc-4a1f-9222-23c49a6d095a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.590155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d289dfa-affc-4a1f-9222-23c49a6d095a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.590680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d289dfa-affc-4a1f-9222-23c49a6d095a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.591159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d289dfa-affc-4a1f-9222-23c49a6d095a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.599492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d289dfa-affc-4a1f-9222-23c49a6d095a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.601338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d289dfa-affc-4a1f-9222-23c49a6d095a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-6d289dfa-affc-4a1f-9222-23c49a6d095a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:23.614342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:23.615362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:23.616416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:23.623308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 364/738] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:23.623308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e190-7ff7-4643-8531-c761b6592832 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.623308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e190-7ff7-4643-8531-c761b6592832 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.623308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373e190-7ff7-4643-8531-c761b6592832 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.625943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 365/739] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:23.627840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373e190-7ff7-4643-8531-c761b6592832 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.642255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:23.645645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87e0115-3be7-4f28-b8eb-4f0ce3f3c778 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.686491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.687468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.687914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.688192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.688945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:23.689255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.690754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.699709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 375/740] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:23.700708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.747454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:23.752385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373e190-7ff7-4643-8531-c761b6592832 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.788195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b0bb8-0f1a-4ecb-b337-46ca0f14de2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.789026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b0bb8-0f1a-4ecb-b337-46ca0f14de2b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.789332 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b0bb8-0f1a-4ecb-b337-46ca0f14de2b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.789646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b0bb8-0f1a-4ecb-b337-46ca0f14de2b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.798798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b0bb8-0f1a-4ecb-b337-46ca0f14de2b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.800306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055b0bb8-0f1a-4ecb-b337-46ca0f14de2b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.807115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b2af4b-fa2c-4980-8ab6-0701be1980d0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-055b0bb8-0f1a-4ecb-b337-46ca0f14de2b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:23.812805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:23.813750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:23.815203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:23.818927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 366/741] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:23.819969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014f85-6b01-4288-9df1-6a8beb75356f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.820260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014f85-6b01-4288-9df1-6a8beb75356f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.820536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51014f85-6b01-4288-9df1-6a8beb75356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.839038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-51014f85-6b01-4288-9df1-6a8beb75356f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:23.840303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-51014f85-6b01-4288-9df1-6a8beb75356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:23.842783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:23.843517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:23.843792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:23.844069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:23.845459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:23.845780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:23.847203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:23.865377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 376/742] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:23.866236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.890268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:23.919632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 367/743] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 27 18:05:23.921165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51014f85-6b01-4288-9df1-6a8beb75356f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:23.974907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e411e47-b3f7-4b5f-af81-ea99abf88840 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.014535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.015507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.015792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.016068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.027349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.028800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.033362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.043883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51014f85-6b01-4288-9df1-6a8beb75356f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:24.044614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:24.045713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:24.046630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:24.046630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:24.046630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:24.046630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:24.050081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 377/744] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:24.051220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.084491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.085114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.085395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.085671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.086523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:24.086829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.088262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.110642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 368/745] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 18:05:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:24.111754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.133677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.165216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32f5e0-3788-4e19-9c3e-d2c299348864 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.204581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.205354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.205640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.205958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.217165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3275e924-58fe-4261-a11d-d0c6f46879b8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.254415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.255185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.255469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.255738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.256463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.257832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.341831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 369/746] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:24 2022] POST /identity/v3/services => generated 240 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:24.342876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.359238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.366080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.399082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 378/747] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:24 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 27 18:05:24.400465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.530230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7cdd19-73ea-43a5-a707-ed293c50c1e1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.543382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75323a0d-6fc8-4bec-b9f7-d61679a31d4e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.573504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.574186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.574440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.574723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.584233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.585072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.585497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.585934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.586758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:24.587220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.588722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.601014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 370/748] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:24.602074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.623319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.656801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.658377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.678330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.720790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868d758-95a2-445e-bd9f-ca28ebdb4bf1 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.764789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.766095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.766628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.767096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.781623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.783939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.787456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 379/749] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:05:24.788429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:24.803568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:24.804465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:24.805349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:24.805349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:24.805349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:24.805349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:24.807884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 371/750] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:24.809145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.867942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.900150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fa595b-fca0-46c9-b99d-052ec9e2aa96 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.936514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.937367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.937950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.938303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:24.944373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992533f-53a4-4523-9461-e7fe391964dc None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:24.946797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:24.948431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:24.961397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:24.962589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:24.963753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:24.965140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 380/751] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:05:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:24.971220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:24.972251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:24.989146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:24.993786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:24.993786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:24.993786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.004207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.005647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:25.020431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:25.021334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:25.022260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:25.022260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:25.022260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:25.022260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:25.026207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 372/752] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:25.027226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.100253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81a0292-a97f-4f6f-bd73-2b21c89db33a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.136007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:25.142690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.143604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.144320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.146116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.146116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:25.146116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.147526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.153698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e7af33-412e-42d4-859f-94fdfdbb0ab6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.161931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 381/753] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:25.163814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.200835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.202041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.205267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.205651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.206617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:25.207067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.209141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.234083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 373/754] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:25.234945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.269404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:25.282702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4457bd-2940-430e-8a65-7c51a59d3ecc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.320443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.321068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.321348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.321620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.322361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:25.322665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.324195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.341591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 382/755] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:25.342586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.348103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfc21ca-4c18-4d95-900d-8b9aee6cffa4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.384266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.385123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.385670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.386115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.394101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.395768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.399616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:25.408969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:25.410079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:25.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:25.413208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 374/756] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:25.414253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.449915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd558381-5db9-4a0b-8a70-93c5d963d439 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.490861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.491508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.491790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.492066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.504249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.505721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.513245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:25.522638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:25.528712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:25.530096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:25.530096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:25.530096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:25.530096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:25.530096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 383/757] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:25.530096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.532797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d4b9a-1361-433c-a0f0-c5bc0c4089fa None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.572340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.572996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.573260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.573527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.581272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.582853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:25.596186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:25.597341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:25.598313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 375/758] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:25.598871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.649970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16adb22-9a6f-4cf5-bde8-10176020cf4f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.653006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:25.688061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.689328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.689600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.690032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.690795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:25.691098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.692519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.704191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 384/759] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:25.709277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.718533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2062a0e2-651a-4480-9554-337c2080c2f9 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.755666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee1868e-16f6-401f-9392-c0bfca6e7ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.756271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1868e-16f6-401f-9392-c0bfca6e7ecb None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.756549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1868e-16f6-401f-9392-c0bfca6e7ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.756820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1868e-16f6-401f-9392-c0bfca6e7ecb None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.757495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1868e-16f6-401f-9392-c0bfca6e7ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:25.757811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1868e-16f6-401f-9392-c0bfca6e7ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.759167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee1868e-16f6-401f-9392-c0bfca6e7ecb None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.775618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 376/760] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:25.775618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547f3dc-69b7-4b2f-b1bd-ebc78ca7e101 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.775618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547f3dc-69b7-4b2f-b1bd-ebc78ca7e101 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.775618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547f3dc-69b7-4b2f-b1bd-ebc78ca7e101 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.775618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 377/761] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:25.775618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547f3dc-69b7-4b2f-b1bd-ebc78ca7e101 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.786045 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:25.818603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8a7db3-fda2-4506-b02d-12594448a2ab None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.853136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.853863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.854215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.854556 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.855368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:25.855754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.857249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.874598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 385/762] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:25.874598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:25.888517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547f3dc-69b7-4b2f-b1bd-ebc78ca7e101 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:25.898618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:25.925018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff7e95f-eae4-45a9-9c3b-167024526800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:25.925694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e95f-eae4-45a9-9c3b-167024526800 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.926069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e95f-eae4-45a9-9c3b-167024526800 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.926452 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff7e95f-eae4-45a9-9c3b-167024526800 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.927300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7e95f-eae4-45a9-9c3b-167024526800 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8538be4294e842e58aca6881db9002e8) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:25.927720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7e95f-eae4-45a9-9c3b-167024526800 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:25.929225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff7e95f-eae4-45a9-9c3b-167024526800 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:25.934829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 378/763] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/role_assignments?user.id=8538be4294e842e58aca6881db9002e8&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:25.943507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b67f-e924-4a22-9715-738b427b8399 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:25.943791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b67f-e924-4a22-9715-738b427b8399 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:25.944059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed2b67f-e924-4a22-9715-738b427b8399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:25.965374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0ed2b67f-e924-4a22-9715-738b427b8399 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:25.966663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0ed2b67f-e924-4a22-9715-738b427b8399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:25.985806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a716a114-044a-44dd-b681-b432d4905fa1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:26.024553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:26.025565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.026060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.026518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.035471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:26.037288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:26.046306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:26.050869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:26.051818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:26.052711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:26.053138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 379/764] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:26.053489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b67f-e924-4a22-9715-738b427b8399 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.059659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 386/765] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:26.060712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.162567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed2b67f-e924-4a22-9715-738b427b8399 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:26.172146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:26.178419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc8bba-23cf-4cba-8dad-0c327d8b3efe None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:26.198063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:26.198683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.208608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.208608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.208608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:26.208608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:26.208608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:26.213858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 380/766] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:26 2022] GET /identity/v3/role_assignments?user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:26.215816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.221708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:26.222679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.223113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.224001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.225012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:26.227077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:26.233039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:26.257108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 387/767] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:26.265537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.356361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:26.425793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1338bab6-0054-4f1e-84fb-2451a7b6c68b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:26.460931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:26.461562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.461857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.462128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.462979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:26.465381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749b1244-bb11-4abc-84f7-ecaa6a425a4b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:26.467788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:26.482999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:26.483966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:26.484810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 381/768] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 27 18:05:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:26.491249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.525912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9ee374-6492-4873-bb4d-98e4995c1a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:26.527033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ee374-6492-4873-bb4d-98e4995c1a98 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.527826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ee374-6492-4873-bb4d-98e4995c1a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.528101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9ee374-6492-4873-bb4d-98e4995c1a98 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/4e107a27b86243dcbb160a3960682b2d/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.530763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ee374-6492-4873-bb4d-98e4995c1a98 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=4e107a27b86243dcbb160a3960682b2d, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:26.533344 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9ee374-6492-4873-bb4d-98e4995c1a98 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:26.609184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d037d-e095-489c-b481-6e0381ec1de0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:26.627226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 388/769] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:26 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/4e107a27b86243dcbb160a3960682b2d/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:26.629807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90643a03-f4b0-4921-8e6d-f4c270554dd0 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.630826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90643a03-f4b0-4921-8e6d-f4c270554dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.631703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90643a03-f4b0-4921-8e6d-f4c270554dd0 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.635197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 389/770] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:26.641242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527254c-efec-42d8-b042-4046e0c91376 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.641773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527254c-efec-42d8-b042-4046e0c91376 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.642059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527254c-efec-42d8-b042-4046e0c91376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.658130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:26.659494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:26.679094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:26.679796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.680143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.680422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.681124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:26.681427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:26.682881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:26.685017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9527254c-efec-42d8-b042-4046e0c91376 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:26.686337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9527254c-efec-42d8-b042-4046e0c91376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:26.697144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 382/771] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 18:05:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:26.702796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.843280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fa0a8-558c-4c78-960b-7c3d3a9943a2 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:26.859443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 390/772] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:26.880714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:26.881389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:26.881676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:26.881987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:26.882669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:26.882982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:26.884404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:26.889728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 383/773] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 18:05:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:26.895239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527254c-efec-42d8-b042-4046e0c91376 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.900314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:26.970300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:27.013531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299fbc4-dbc1-4775-a0ea-b04da4930d53 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:27.053876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:27.054553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.054834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.055111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] PATH_INFO: `/v3/services/network` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.059425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:27.059425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:27.067907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:27.068909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:27.069738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 384/774] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:26 2022] GET /identity/v3/services/network => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:27.075299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:27.192779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f3c209-6475-4b05-8ad1-2afa05e2838b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:27.207890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527254c-efec-42d8-b042-4046e0c91376 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:27.226276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:27.233998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:27.234625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.234905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.235207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.235890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] RBAC: Adding query filter params (name=network) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:27.236193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:27.237585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:27.243139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 385/775] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:27.248681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:27.357950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba065456-149b-43e9-ba50-da181ff91d6a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:27.362469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:27.363123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.363408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.363688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.364460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] RBAC: Adding query filter params (interface=public, service_id=24396ac4ec464b72b42a53dd5dc5fa4a, region_id=RegionOne) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:27.364776 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:27.366255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:27.368175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:27.392352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 391/776] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:05:26 2022] GET /identity/v3/endpoints?service_id=24396ac4ec464b72b42a53dd5dc5fa4a&interface=public®ion_id=RegionOne => generated 194 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:27.394504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:27.395146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.395426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.395702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.396405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] RBAC: Adding query filter params (type=network) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:27.396708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:27.398276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:27.402728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:27.403969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 386/777] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:27.410402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:27.466156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:27.522389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2979874e-9ea1-4812-8c35-44a1850b0230 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:27.562336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:27.562982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.563489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.563775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.564540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] RBAC: Adding query filter params (interface=public, service_id=5b9d07c0a21446bf9b295b428da0ed6d, region_id=RegionOne) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:27.564852 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:27.566279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:27.575042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 387/778] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:05:27 2022] GET /identity/v3/endpoints?service_id=5b9d07c0a21446bf9b295b428da0ed6d&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:27.580358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:27.697723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a1af0b-eb29-4741-8d7e-00da569f085e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:27.724126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c532-3819-4598-8ec7-023de0a569d0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:27.734372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca20f55-c905-4c47-95a4-fa3509c3809a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:27.735040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20f55-c905-4c47-95a4-fa3509c3809a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.735325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20f55-c905-4c47-95a4-fa3509c3809a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.735599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca20f55-c905-4c47-95a4-fa3509c3809a None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.736262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca20f55-c905-4c47-95a4-fa3509c3809a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:27.737649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca20f55-c905-4c47-95a4-fa3509c3809a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:27.743637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 392/779] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:27 2022] GET /identity/v3/services => generated 772 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:27.754464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:27.776633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bed572-522f-451c-9820-7b878245294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:27.777468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed572-522f-451c-9820-7b878245294d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:27.777902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed572-522f-451c-9820-7b878245294d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:27.778321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bed572-522f-451c-9820-7b878245294d None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:27.779342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bed572-522f-451c-9820-7b878245294d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:27.780990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bed572-522f-451c-9820-7b878245294d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:27.787255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 388/780] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:27 2022] GET /identity/v3/services => generated 772 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:28.201645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7624-ac2f-4b5b-8609-2d600fffb2c3 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:28.202200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7624-ac2f-4b5b-8609-2d600fffb2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:28.202291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f7624-ac2f-4b5b-8609-2d600fffb2c3 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:28.203849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 393/781] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:28.209299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889fb43-be83-4ed2-8e60-ee1a73c347be None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:28.209707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889fb43-be83-4ed2-8e60-ee1a73c347be None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:28.209914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6889fb43-be83-4ed2-8e60-ee1a73c347be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:28.235802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6889fb43-be83-4ed2-8e60-ee1a73c347be None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:28.237010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6889fb43-be83-4ed2-8e60-ee1a73c347be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:28.321556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 389/782] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:28.343428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7624-ac2f-4b5b-8609-2d600fffb2c3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:28.410965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:28.452762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f7624-ac2f-4b5b-8609-2d600fffb2c3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:28.489165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:28.489937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:28.490292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:28.490636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:28.501567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:28.507162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:28.508090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:28.508957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 394/783] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:28.514596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889fb43-be83-4ed2-8e60-ee1a73c347be None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:28.655141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6889fb43-be83-4ed2-8e60-ee1a73c347be None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:28.668412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:28.711967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d2845b-7302-48c2-877c-2b2bea457b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:28.712979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2845b-7302-48c2-877c-2b2bea457b4d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:28.713461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2845b-7302-48c2-877c-2b2bea457b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:28.713959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d2845b-7302-48c2-877c-2b2bea457b4d None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:28.714911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2845b-7302-48c2-877c-2b2bea457b4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:28.715500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2845b-7302-48c2-877c-2b2bea457b4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:28.717085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d2845b-7302-48c2-877c-2b2bea457b4d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:28.730157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 390/784] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:28.735842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:28.774152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2ade4-e0d2-483b-872e-b54512b19123 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:28.774772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2ade4-e0d2-483b-872e-b54512b19123 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:28.775367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2ade4-e0d2-483b-872e-b54512b19123 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:28.777189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 391/785] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:28.782915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d9ae-285c-48d6-90ac-c8838858c25c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:28.783202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d9ae-285c-48d6-90ac-c8838858c25c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:28.783483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c1d9ae-285c-48d6-90ac-c8838858c25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:28.827113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-42c1d9ae-285c-48d6-90ac-c8838858c25c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:28.828323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-42c1d9ae-285c-48d6-90ac-c8838858c25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:28.859658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f896d0a-5b75-46c3-a77d-4962dbfa661e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:28.886159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:28.907779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:28.908450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:28.908736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:28.909014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:28.920437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:28.921869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:28.936668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:28.937643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:28.939157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:28.939157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:28.939157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:28.939157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:28.939157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 395/786] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:28.944358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.003492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 392/787] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:29.038682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90921-607a-4a75-b6d4-4cb6f4cdb939 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.039003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90921-607a-4a75-b6d4-4cb6f4cdb939 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.039244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b90921-607a-4a75-b6d4-4cb6f4cdb939 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.040997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 393/788] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:29.041941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90921-607a-4a75-b6d4-4cb6f4cdb939 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.047199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cea3c2-dd35-494f-8d2a-1d1889fe8d56 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.084734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e694fe2-9143-4e03-a0a8-55c952ddf52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.085350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694fe2-9143-4e03-a0a8-55c952ddf52e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.085633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694fe2-9143-4e03-a0a8-55c952ddf52e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.085933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e694fe2-9143-4e03-a0a8-55c952ddf52e None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.086609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694fe2-9143-4e03-a0a8-55c952ddf52e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:29.086911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694fe2-9143-4e03-a0a8-55c952ddf52e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.088267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e694fe2-9143-4e03-a0a8-55c952ddf52e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.101260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 396/789] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:29.108574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ba07-c442-478f-820d-d145e9b49621 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.108856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ba07-c442-478f-820d-d145e9b49621 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.109129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc94ba07-c442-478f-820d-d145e9b49621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.137926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-cc94ba07-c442-478f-820d-d145e9b49621 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:29.139441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cc94ba07-c442-478f-820d-d145e9b49621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:29.169923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.174740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.176115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b90921-607a-4a75-b6d4-4cb6f4cdb939 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.222219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.223673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.224153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.224654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.228379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 397/790] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:29.229750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ba07-c442-478f-820d-d145e9b49621 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.238608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:29.244322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:29.245241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:29.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:29.248855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 394/791] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:29.257595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.349742 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc94ba07-c442-478f-820d-d145e9b49621 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.376114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af8ea46-4fe7-4534-ae30-609edf769cc4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.384942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.385599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.385922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.386271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.394196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.395647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:29.409228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:29.410248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:29.411211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 398/792] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:29.411788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.420279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.421219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.421780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.422261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.423196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:29.423694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.425445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.435454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 395/793] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:29.436643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.442203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.461289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.518635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75791019-91c6-4256-9af9-e69865b21f2e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.549246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d875a70-c459-4bca-9a5a-60eeccd027e4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.554103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.554753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.555036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.555311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.565659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:29.570586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:29.571485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:29.572319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:29.576734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 399/794] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:29.577615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.590370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.591381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.591834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.592281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.593278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:29.593916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.596246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.616430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 396/795] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:29.617577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.682443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.703242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db319778-0ca4-473f-98fd-05b5cfe99967 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.719836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.747903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913c63a2-4c24-4cc7-bc52-73f0a3e865ad None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.752069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.752974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.753467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.753961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.767831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.770102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.788389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.789010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.789290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.789563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.790317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:29.790625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:29.790889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:29.791727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:29.792592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:29.792592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:29.792592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:29.792592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:29.792819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.795427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 400/796] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:29.796429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.805591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 397/797] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:29.806559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.909948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2575778-e442-4557-a1bf-e2e49dfa1c3d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.914261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816b5e-7594-4fef-8ed9-5b9a7ea03533 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:29.946300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.947288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.947784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.948247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.951384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.953011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:29.954258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:29.954602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:29.954877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:29.955642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:29.955946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.957319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.962862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:29.965311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:29.966884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:29.971041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 398/798] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:29.971851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:29.981087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:29.982003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:29.982883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:29.982883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:29.982883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:29.982883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:29.985056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 401/799] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:29.986047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.091005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d2c7bf-84c9-4353-a769-dd491b998c70 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.096430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed984ae8-fe4f-40e5-846c-003b5c9ad190 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.136061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.137009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.137464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.137915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.138198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.138562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.138844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.139118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.147061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.148734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.150438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.152093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:30.161058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:30.162031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:30.162975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:30.165591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 402/800] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:30.166632 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:30.167808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:30.168659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:30.169519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:30.169519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:30.169519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:30.169519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:30.174442 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 399/801] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:30.175573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.221467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.234616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.274053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b078b-8249-4c2e-be01-3b7d86b90dc8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.282766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eefbac1-1cb2-4ce3-a1d7-b150a5643afd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.307633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.308247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.308532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.308859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.309531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:30.309866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.311230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.316909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8b51a-98c8-4fd4-951c-56273211e91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.317534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b51a-98c8-4fd4-951c-56273211e91e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.317815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b51a-98c8-4fd4-951c-56273211e91e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.318089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8b51a-98c8-4fd4-951c-56273211e91e None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.318868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b51a-98c8-4fd4-951c-56273211e91e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:30.319169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b51a-98c8-4fd4-951c-56273211e91e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.320554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8b51a-98c8-4fd4-951c-56273211e91e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.323613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 403/802] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:30.324416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.337534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 400/803] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:30.338817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218413a-7afe-4033-b37e-eec688fcb65a None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.339098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218413a-7afe-4033-b37e-eec688fcb65a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.339371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a218413a-7afe-4033-b37e-eec688fcb65a None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.340571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 401/804] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:30.341572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d86b-389f-42dc-895d-c309edc0ed4c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.341895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d86b-389f-42dc-895d-c309edc0ed4c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.342143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d46d86b-389f-42dc-895d-c309edc0ed4c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.343317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 402/805] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:30.345154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46d86b-389f-42dc-895d-c309edc0ed4c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.429938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a39e-603f-4526-8f41-bae487372b8a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.439054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.443012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d46d86b-389f-42dc-895d-c309edc0ed4c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.453555 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.462630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.463290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.463571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.463844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.464524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:30.464826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.466218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.476548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400b6610-3041-4a05-9cfb-5bd88c365388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.477184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6610-3041-4a05-9cfb-5bd88c365388 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.477466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6610-3041-4a05-9cfb-5bd88c365388 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.477739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b6610-3041-4a05-9cfb-5bd88c365388 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.478744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 404/806] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:30.479537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.484715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b6610-3041-4a05-9cfb-5bd88c365388 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.486737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400b6610-3041-4a05-9cfb-5bd88c365388 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-400b6610-3041-4a05-9cfb-5bd88c365388 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:30.498133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:30.499080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:30.499996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:30.501912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 403/807] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:30.503364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0968-c109-4b84-aa90-81f1d4bd689b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.503972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0968-c109-4b84-aa90-81f1d4bd689b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.504089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eba0968-c109-4b84-aa90-81f1d4bd689b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.521101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-2eba0968-c109-4b84-aa90-81f1d4bd689b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:30.522338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2eba0968-c109-4b84-aa90-81f1d4bd689b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:30.578144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45fb2ee-a6f6-409c-8b65-fb99cf4ecdad None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.609790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 404/808] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:30.609790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1adb1-c0bb-4112-8022-61b93d4fe222 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.609790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1adb1-c0bb-4112-8022-61b93d4fe222 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.609790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1adb1-c0bb-4112-8022-61b93d4fe222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.609790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d2d1adb1-c0bb-4112-8022-61b93d4fe222 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:30.609790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d2d1adb1-c0bb-4112-8022-61b93d4fe222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:30.613652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.614343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.614652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.614904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.649153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.678043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 405/809] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:30.678880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1adb1-c0bb-4112-8022-61b93d4fe222 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.681521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.683167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.711380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.779397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1adb1-c0bb-4112-8022-61b93d4fe222 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.782120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 405/810] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:05:30.782976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.814091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.814795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.815076 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.815350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.822904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.824342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:30.836419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:30.837462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 406/811] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:30.843369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.848695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.888364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae3fee-fee7-4a0a-a533-5034482b77d1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.923143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.923753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.924037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.924304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.925035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:30.925334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.926774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.929496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:30.938441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14550435-fbda-4338-a02e-9e3950211de6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:30.938812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 406/812] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:30.949545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:30.971856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:30.972493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:30.972779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:30.973252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:30.974121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:30.975848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:30.984776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:30.985983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:30.986831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 407/813] 10.222.0.67 () {56 vars in 1129 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:30.987675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.042000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0649b-489d-467f-a929-fa65612ac950 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.066942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:31.074298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.074932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.075212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.075534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] PATH_INFO: `/v3/services/network` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.076145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.081044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:31.086931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:31.087980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:31.088882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 407/814] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:31.089681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.095373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19f515e-8ea2-43c1-9754-125457457ccd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.133479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.134163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.134429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.134699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.145127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.146581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:31.163080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:31.164169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:31.165057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:31.165057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:31.165057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:31.165057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:31.165057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 408/815] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:31.165569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.177300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:31.197738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ef2ab-b0a5-419c-af39-af66530d953d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.234692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.236008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.236292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.236569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.237403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:31.238474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.239315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.256360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 408/816] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:31.260777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.268075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160cd01-da46-4f32-ae13-d34dac98b195 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.312165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.312165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.312165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.312165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8538be4294e842e58aca6881db9002e8/roles/fde07f9dcebb4680a98ab1f9c8d97c2a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.312589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:31.318039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=8538be4294e842e58aca6881db9002e8, role_id=fde07f9dcebb4680a98ab1f9c8d97c2a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.319481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.355248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3691bb-e443-4058-8827-eb74a4dadfce None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.388462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.389067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.389347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.389621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.390317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:31.390622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.392091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.396371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 409/817] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:31.397127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.404653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 409/818] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:31 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8538be4294e842e58aca6881db9002e8/roles/fde07f9dcebb4680a98ab1f9c8d97c2a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:31.405486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.476218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:31.511161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a76896-1769-42b8-9dd0-0934a07e61ba None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.524576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6134303-2a15-470a-80c8-6c6a07650ae6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.526299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:31.550824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743678-b995-4a53-a958-d719584aef86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.551485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743678-b995-4a53-a958-d719584aef86 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.551764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743678-b995-4a53-a958-d719584aef86 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.552048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743678-b995-4a53-a958-d719584aef86 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.552724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44743678-b995-4a53-a958-d719584aef86 None admin] RBAC: Adding query filter params (name=network) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:31.553028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44743678-b995-4a53-a958-d719584aef86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.554682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44743678-b995-4a53-a958-d719584aef86 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.561788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 410/819] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:31.564114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743678-b995-4a53-a958-d719584aef86 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.570375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.571016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.571353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.572018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.572748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:31.572748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.574633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.588726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 410/820] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:31.589692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.673054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743678-b995-4a53-a958-d719584aef86 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.700188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3e16d-06fc-4364-85a9-66c90b332e25 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.706574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.707229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.707514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.707796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.717839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:31.718745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.720763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:31.735536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:31.736476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:31.737374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:31.737374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:31.737374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:31.737374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:31.737374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 411/821] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:31.737654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.742399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.743238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.743693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.744189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.745181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:31.745487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.746899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.757242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 411/822] 10.222.0.67 () {56 vars in 1124 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:31.758246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.778063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:31.852143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934e020f-eb70-4331-b515-1b4976d4c5fd None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.872741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c7260f-b1dc-4696-a4b1-eaf7594d371c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:31.888630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.889258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.889539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.889836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.890511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:31.890819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.892759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.902209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 412/823] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:31.902209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.916532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:31.917173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:31.917457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:31.917731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:31.925058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:31.926572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:31.939035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:31.939952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:31.940831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:31.945061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 412/824] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:31.945903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:31.993207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:32.000094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:32.007259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674cca9c-2522-45a2-b38d-87c176e88bf6 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.044632 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.045576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.045951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.046239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.046929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:32.047271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.048713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:32.054185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946f6040-79e4-4b7e-8e97-526d3da82dec None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.060650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 413/825] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:32.062686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:32.091654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.092273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.092555 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.092826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.093527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.095005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:32.177711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ab0670-7cc5-45c6-8412-867d2b8c2cda None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.211041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 413/826] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:05:31 2022] POST /identity/v3/endpoints => generated 346 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:32.211873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:32.231789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.233005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.233290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.233576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.234347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.235768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:32.338511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 414/827] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:05:32 2022] POST /identity/v3/endpoints => generated 327 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:32.340301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:32.341743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:32.348766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8006c4-a04c-44f5-a449-200beac1eb13 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.362780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:32.417857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.418511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.418797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.419077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.419991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:32.420301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.422079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:32.445890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 414/828] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:32.450725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:32.537930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efd58cd-0d86-423b-bfad-34bf039bc9ec None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.581718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a68e40-c219-47d2-8dcd-c2bc9eee40ac None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.584467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.586497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.590058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.590350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.600362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.602776 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:32.619254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:32.620214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:32.621480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 415/829] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:32.627045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:32.629905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.630592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.630874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.631201 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.632069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=4e107a27b86243dcbb160a3960682b2d) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:32.632380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.633841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:32.641823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 415/830] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:32 2022] GET /identity/v3/role_assignments?user.id=4e107a27b86243dcbb160a3960682b2d&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:32.707050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:32.747039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a31437a-1a8e-4489-8a39-cba087c1d0d2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.784561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0352ee7c-9a7b-4d9c-8db6-8c59f0aca728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.785201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ee7c-9a7b-4d9c-8db6-8c59f0aca728 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.785482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ee7c-9a7b-4d9c-8db6-8c59f0aca728 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.785758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0352ee7c-9a7b-4d9c-8db6-8c59f0aca728 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.786552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ee7c-9a7b-4d9c-8db6-8c59f0aca728 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:32.786860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ee7c-9a7b-4d9c-8db6-8c59f0aca728 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.788320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0352ee7c-9a7b-4d9c-8db6-8c59f0aca728 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:32.802977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 416/831] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:32.809391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:32.831689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:32.922490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dd40dc-09cb-492e-9db8-e646f297f776 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:32.958759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2b85f3-f05b-4ed5-91f5-20224a0a9403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:32.959453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b85f3-f05b-4ed5-91f5-20224a0a9403 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:32.959818 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b85f3-f05b-4ed5-91f5-20224a0a9403 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:32.960163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2b85f3-f05b-4ed5-91f5-20224a0a9403 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/e70a3ed5aa5441fb9e8d4ed8f071bcc0/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:32.962201 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b85f3-f05b-4ed5-91f5-20224a0a9403 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=e70a3ed5aa5441fb9e8d4ed8f071bcc0, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:32.963705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2b85f3-f05b-4ed5-91f5-20224a0a9403 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:33.034808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 416/832] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:32 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/e70a3ed5aa5441fb9e8d4ed8f071bcc0/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:05:33.488413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660fcb-89b2-430f-a725-fd8fcce30cd2 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:33.489298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660fcb-89b2-430f-a725-fd8fcce30cd2 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:33.489723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee660fcb-89b2-430f-a725-fd8fcce30cd2 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:33.491513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 417/833] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:33.497207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1e078-de96-4058-8e0e-112c3508fafa None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:33.498060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1e078-de96-4058-8e0e-112c3508fafa None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:33.498565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b1e078-de96-4058-8e0e-112c3508fafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:33.517357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-15b1e078-de96-4058-8e0e-112c3508fafa None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:33.518917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-15b1e078-de96-4058-8e0e-112c3508fafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:33.595727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 417/834] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:33.618679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660fcb-89b2-430f-a725-fd8fcce30cd2 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:33.728919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee660fcb-89b2-430f-a725-fd8fcce30cd2 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:33.756516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:33.765186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:33.766305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:33.766589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:33.766916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:33.777970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:33.784196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:33.785186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:33.786171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 418/835] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:05:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:33.793448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1e078-de96-4058-8e0e-112c3508fafa None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:33.814122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:33.901208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b1e078-de96-4058-8e0e-112c3508fafa None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:33.938325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:33.938989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:33.939253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:33.939581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:33.940294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:33.940644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:33.942037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:33.950696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 418/836] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:05:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:33.957200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:34.062511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd5037-5838-428c-bcc5-de08e500e74f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:34.097559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:34.098242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.098563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.098836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.109474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:34.110986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:34.126844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:34.127790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:34.128840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:34.128840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:34.128840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:34.128840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:34.128840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 419/837] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:34.134992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:34.211085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:34.247807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41476443-0fef-4e7d-9422-c9e1750ff74a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:34.283820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:34.284433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.284709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.284980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.285674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:34.286006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:34.287361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:34.301003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 419/838] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:34.306692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:34.349828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:34.413973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94b52f-b1db-4cf0-8243-f7815626b7de None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:34.449096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3055bb-dd19-4418-a3ce-56554757c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:34.449745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3055bb-dd19-4418-a3ce-56554757c476 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.450060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3055bb-dd19-4418-a3ce-56554757c476 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.450382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3055bb-dd19-4418-a3ce-56554757c476 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.458366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3055bb-dd19-4418-a3ce-56554757c476 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:34.459823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3055bb-dd19-4418-a3ce-56554757c476 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-5d3055bb-dd19-4418-a3ce-56554757c476 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:34.471663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:34.472619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:34.473542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:34.477544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 420/839] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:05:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:34.478974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:34.533491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84327-79fc-463b-82e9-0cc97fa66f8f None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.534030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84327-79fc-463b-82e9-0cc97fa66f8f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.534108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b84327-79fc-463b-82e9-0cc97fa66f8f None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.535795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 421/840] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:34.541341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c9e7-ca92-4acf-b7bd-daa7735b944d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.541629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c9e7-ca92-4acf-b7bd-daa7735b944d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.541938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c9e7-ca92-4acf-b7bd-daa7735b944d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.562237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c180c9e7-ca92-4acf-b7bd-daa7735b944d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:34.563555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c180c9e7-ca92-4acf-b7bd-daa7735b944d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:34.592572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32d689-5f50-4bec-b402-3110db23014f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:34.620460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:34.629403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:34.630453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.630892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.635066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.635066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:34.635066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:34.635066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:34.645789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 422/841] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:34.665838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180c9e7-ca92-4acf-b7bd-daa7735b944d None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:34.666182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 420/842] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 18:05:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:34.667567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:34.697738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:34.774909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1d676d-048f-4669-8a85-b5eb67e53d39 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:34.775109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180c9e7-ca92-4acf-b7bd-daa7735b944d None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:34.811859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:34.812608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.813433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf85800c-a233-4f2b-a971-275ac7f818da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:34.813547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.813909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.814427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85800c-a233-4f2b-a971-275ac7f818da None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.814728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85800c-a233-4f2b-a971-275ac7f818da None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.815015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf85800c-a233-4f2b-a971-275ac7f818da None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.815680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85800c-a233-4f2b-a971-275ac7f818da None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:34.817135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf85800c-a233-4f2b-a971-275ac7f818da None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-cf85800c-a233-4f2b-a971-275ac7f818da None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:34.827086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:34.828055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:34.828931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 423/843] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:34.829714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7e7a-9686-4312-8551-a53f9c6e5cd7 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.830436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7e7a-9686-4312-8551-a53f9c6e5cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.830436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eb7e7a-9686-4312-8551-a53f9c6e5cd7 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.833917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 424/844] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:34.834040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb7e7a-9686-4312-8551-a53f9c6e5cd7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:34.878736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:34.891619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:34.893063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:34.934214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:34.945399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eb7e7a-9686-4312-8551-a53f9c6e5cd7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:34.983323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dbf261-7634-4844-b6b9-b358fddff6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:34.983945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf261-7634-4844-b6b9-b358fddff6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.984225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf261-7634-4844-b6b9-b358fddff6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.984521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dbf261-7634-4844-b6b9-b358fddff6e4 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:34.985721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbf261-7634-4844-b6b9-b358fddff6e4 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:34.986056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbf261-7634-4844-b6b9-b358fddff6e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:34.987425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dbf261-7634-4844-b6b9-b358fddff6e4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:34.991816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 425/845] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:34.992946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8c5d-ac77-426f-bead-20395d4557f6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:34.993228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8c5d-ac77-426f-bead-20395d4557f6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:34.993501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543c8c5d-ac77-426f-bead-20395d4557f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.010652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 421/846] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:05:35.011817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-543c8c5d-ac77-426f-bead-20395d4557f6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:35.012142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.013865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-543c8c5d-ac77-426f-bead-20395d4557f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:35.083369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 426/847] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:35.084213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8c5d-ac77-426f-bead-20395d4557f6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.120902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:35.135639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d9c65-02cd-415f-af5d-627c39d03c51 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.171593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a146cd-a08a-4789-99e7-1bf46fdbc633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.172816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a146cd-a08a-4789-99e7-1bf46fdbc633 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.173104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a146cd-a08a-4789-99e7-1bf46fdbc633 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.173380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a146cd-a08a-4789-99e7-1bf46fdbc633 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.174089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a146cd-a08a-4789-99e7-1bf46fdbc633 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:35.174390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a146cd-a08a-4789-99e7-1bf46fdbc633 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.175747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a146cd-a08a-4789-99e7-1bf46fdbc633 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.180149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 422/848] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:35.181292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9bcae-2d9e-4510-835d-af0511476724 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.181576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9bcae-2d9e-4510-835d-af0511476724 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.181679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:35.181880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e9bcae-2d9e-4510-835d-af0511476724 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.183534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 423/849] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:35.184290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9bcae-2d9e-4510-835d-af0511476724 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.199332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543c8c5d-ac77-426f-bead-20395d4557f6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.252602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b839bd-1dd0-46d2-ab2b-fcb166235199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.253620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b839bd-1dd0-46d2-ab2b-fcb166235199 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.254103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b839bd-1dd0-46d2-ab2b-fcb166235199 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.254485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b839bd-1dd0-46d2-ab2b-fcb166235199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.267717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b839bd-1dd0-46d2-ab2b-fcb166235199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.269292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b839bd-1dd0-46d2-ab2b-fcb166235199 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-e3b839bd-1dd0-46d2-ab2b-fcb166235199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:35.286629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:35.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 427/850] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716154-9af8-49eb-8ed4-de0898158e92 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716154-9af8-49eb-8ed4-de0898158e92 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.294248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e716154-9af8-49eb-8ed4-de0898158e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.310899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-5e716154-9af8-49eb-8ed4-de0898158e92 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:35.312114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5e716154-9af8-49eb-8ed4-de0898158e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:35.321753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e9bcae-2d9e-4510-835d-af0511476724 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.370368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.371294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.371732 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.372013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.372630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.374018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:35.383237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:35.384171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:35.385635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:35.386533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 428/851] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:35.386533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716154-9af8-49eb-8ed4-de0898158e92 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.389285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 424/852] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:35.390171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.409833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:35.460191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:35.494561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e716154-9af8-49eb-8ed4-de0898158e92 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.498648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceafdc2-8727-420d-ab8e-306b78873289 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.532420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.533192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.533588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.534151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.534744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:35.535137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.536606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.541994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.542614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.542895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.543170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.544331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:35.544646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.546622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.548611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 429/853] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:35.549422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.562087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 425/854] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:35.563090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.647643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:35.663159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f146c45-92e4-47d8-b8c3-0e7094d5aaed None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.672335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5752d0-1ad0-4a9a-8d23-5293027ded38 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.691965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:35.699587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.702388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.702388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.702388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.709077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.709715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.710025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.710296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.712547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:35.717297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:35.717874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:35.718792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:05:35.720290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:35.720939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.721017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 430/855] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:35.721017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:35.735999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:35.737066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 426/856] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:35.738351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.829523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439cf588-7da6-400d-80da-22ff00f8c8a2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.846384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d389e85-ccb6-418f-b0e0-7479f82f6307 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:35.866801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.867829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.868126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.868402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.869079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:35.869384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.870794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.875669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 431/857] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:35.876464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.893755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:35.894805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:35.895396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:35.895675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:35.896491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:35.896797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:35.898476 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:35.905037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:35.914701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 427/858] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:35.916402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:35.952243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:36.004379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec41b02-09bb-4ee4-a2a0-b1c9dfd53737 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:36.042799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:36.043438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:36.043719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:36.043994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:36.044756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:36.045066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:36.046564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:36.060619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 432/859] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:36.067392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:36.068496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de2ba-f16c-47f5-9985-4fd1994df0e8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:36.118501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:36.119402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:36.119982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:36.120472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:36.134220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:36.136666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:36.156107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:36.160084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:36.162027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:36.162027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:36.162027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:36.162027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:36.162027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 428/860] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:36.166526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:36.192654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193035e2-2953-42b9-9928-7249cf6ec3ff None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:36.210792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:36.223099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:36.238425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:36.239864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:36.240606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:36.241080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:36.243475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8538be4294e842e58aca6881db9002e8) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:36.244418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:36.246094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:36.254534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 433/861] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:36 2022] GET /identity/v3/role_assignments?user.id=8538be4294e842e58aca6881db9002e8&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:36.279582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce61ae-067c-450f-94cd-ccc8366717bf None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:36.319794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:36.320880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:36.321460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:36.321984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:36.322916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:36.323438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:36.325144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:36.341141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 429/862] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:36.351176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:36.473082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f9a700-e9da-4fa1-a0ed-6a34d8bd6834 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:36.509928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:36.510664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:36.510963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:36.511258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:36.520153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:36.521688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:36.534184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:36.535529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:36.536473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 434/863] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:05:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:36.542923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:36.657826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7e35e-5a4f-4ccd-b79f-80cec467e0d8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:36.673167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:36.695808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:36.696753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:36.697212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:36.697650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:36.710690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:36.710690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:36.710690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:36.719571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 430/864] 10.222.0.67 () {56 vars in 1135 bytes} [Wed Jul 27 18:05:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:36.726838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:36.764650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:36.833003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfe41fd-2366-4fff-b87e-96059bf14c3d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:36.871087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:36.871969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:36.872402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:36.872850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:36.957940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:36.959636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:36.993657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:37.059818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 435/865] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:36 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:05:37.065700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:37.170797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e9ea6-9416-4a70-b78f-9720601266da None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:37.206876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5a87f2-a822-4154-bb65-96c10fe45f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:37.207522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a87f2-a822-4154-bb65-96c10fe45f3e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.207796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a87f2-a822-4154-bb65-96c10fe45f3e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.208063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5a87f2-a822-4154-bb65-96c10fe45f3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.218353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a87f2-a822-4154-bb65-96c10fe45f3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:37.220217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5a87f2-a822-4154-bb65-96c10fe45f3e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-fe5a87f2-a822-4154-bb65-96c10fe45f3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:37.235118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:37.236050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:37.236933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:37.236933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:37.236933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:37.236933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:37.236933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 431/866] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:37.242233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:37.247731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f1d5-a5f9-40ec-a2ed-09344d4a0e43 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.247731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f1d5-a5f9-40ec-a2ed-09344d4a0e43 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.247980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427f1d5-a5f9-40ec-a2ed-09344d4a0e43 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.249424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 432/867] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:37.255260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0948d9-e0cd-4afa-a50f-26b88f2e03ce None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.255551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0948d9-e0cd-4afa-a50f-26b88f2e03ce None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.255925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0948d9-e0cd-4afa-a50f-26b88f2e03ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.275716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3e0948d9-e0cd-4afa-a50f-26b88f2e03ce None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:37.276997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3e0948d9-e0cd-4afa-a50f-26b88f2e03ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:37.295266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:37.357375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 433/868] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:37.367827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051cb04c-9636-4883-b2eb-d197b5212ce5 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:37.379994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0948d9-e0cd-4afa-a50f-26b88f2e03ce None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:37.412415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:37.413648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.414552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.415159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.416118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:37.416871 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:37.419124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:37.423362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:37.439527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 436/869] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:37.440683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:37.516259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0948d9-e0cd-4afa-a50f-26b88f2e03ce None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:37.566406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ef446-e46a-4189-8b90-51d72f8953c6 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:37.570025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:37.570877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.571349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.571840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.572723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:37.574302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:37.603169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:37.603852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.604152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.604435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.612263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:37.613834 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:37.626753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:37.627672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:37.628553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 437/870] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:37.634577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:37.635464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 434/871] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:37 2022] POST /identity/v3/services => generated 251 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:37.703060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:37.758170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ac428-b46c-4607-8a38-fb937713c994 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:37.803106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62552df0-363a-4f7a-a79b-b0a844ea08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:37.803971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62552df0-363a-4f7a-a79b-b0a844ea08ea None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.804412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62552df0-363a-4f7a-a79b-b0a844ea08ea None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.804812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62552df0-363a-4f7a-a79b-b0a844ea08ea None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.805675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62552df0-363a-4f7a-a79b-b0a844ea08ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:37.806144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62552df0-363a-4f7a-a79b-b0a844ea08ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:37.807703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62552df0-363a-4f7a-a79b-b0a844ea08ea None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:37.821355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 438/872] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:37.827982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:37.845911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:37.941269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cd6818-3350-4b78-a521-48510f1c43c2 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:37.975983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89411714-9b18-4679-80d5-d48cac488a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:37.976608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411714-9b18-4679-80d5-d48cac488a0b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:37.976883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411714-9b18-4679-80d5-d48cac488a0b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:37.977149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89411714-9b18-4679-80d5-d48cac488a0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:37.977958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411714-9b18-4679-80d5-d48cac488a0b None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:37.978260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411714-9b18-4679-80d5-d48cac488a0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:37.979679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89411714-9b18-4679-80d5-d48cac488a0b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:37.986807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 435/873] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:37 2022] GET /identity/v3/role_assignments?user.id=e70a3ed5aa5441fb9e8d4ed8f071bcc0&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:38.014999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa4fe-3a84-4536-9eeb-e4d6ef55c189 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:38.015325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa4fe-3a84-4536-9eeb-e4d6ef55c189 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:38.015546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fa4fe-3a84-4536-9eeb-e4d6ef55c189 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:38.017350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 439/874] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:38.022764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6760d-e468-4c1d-9995-37acdbf732bf None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:38.023061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6760d-e468-4c1d-9995-37acdbf732bf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:38.023310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d6760d-e468-4c1d-9995-37acdbf732bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:38.043418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a2d6760d-e468-4c1d-9995-37acdbf732bf None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:38.044623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a2d6760d-e468-4c1d-9995-37acdbf732bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:38.120361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 436/875] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:38 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:38.143825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fa4fe-3a84-4536-9eeb-e4d6ef55c189 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:38.258563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fa4fe-3a84-4536-9eeb-e4d6ef55c189 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:38.273466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:38.294478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27d9a8-8678-4a7d-9612-377afe0cb2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:38.295146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27d9a8-8678-4a7d-9612-377afe0cb2a7 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:38.295421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27d9a8-8678-4a7d-9612-377afe0cb2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:38.295696 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27d9a8-8678-4a7d-9612-377afe0cb2a7 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:38.296381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27d9a8-8678-4a7d-9612-377afe0cb2a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:38.298363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e27d9a8-8678-4a7d-9612-377afe0cb2a7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:38.392769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 440/876] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:38 2022] POST /identity/v3/services => generated 269 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:38.503555 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d52239-18e6-4291-8895-140700013f26 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:38.503936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d52239-18e6-4291-8895-140700013f26 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:38.504115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d52239-18e6-4291-8895-140700013f26 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:38.505796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 437/877] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:38.511446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e019b-c93f-4b66-81e0-eb74229636c5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:38.511745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e019b-c93f-4b66-81e0-eb74229636c5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:38.512021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51e019b-c93f-4b66-81e0-eb74229636c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:38.531913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d51e019b-c93f-4b66-81e0-eb74229636c5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:38.533147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d51e019b-c93f-4b66-81e0-eb74229636c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:38.612892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 441/878] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:38.636620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d52239-18e6-4291-8895-140700013f26 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:38.645746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:38.744405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d52239-18e6-4291-8895-140700013f26 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:38.783063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:38.783708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:38.783982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:38.784252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:38.795388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:38.800943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:38.801913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:38.802795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 438/879] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 18:05:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:38.809467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e019b-c93f-4b66-81e0-eb74229636c5 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:38.922558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:38.926887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51e019b-c93f-4b66-81e0-eb74229636c5 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:38.964086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:38.964446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:38.964752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:38.965045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:38.965828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:38.966162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:38.967561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:38.977046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 442/880] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 18:05:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:38.982736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:39.054133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:39.091991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36bbc97-1d3a-4bbb-89c2-b6e953ad37d1 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:39.138534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:39.139188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:39.139467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:39.139738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:39.150689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:39.152137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:39.170828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:39.171828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:39.172810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:39.172810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:39.172810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:39.172810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:39.172810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 439/881] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:39.179557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:39.291435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfbd0eb-64d9-47b3-b275-97cd3e373c98 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:39.326234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:39.326848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:39.327129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:39.327397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:39.328774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:39.329136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:39.330577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:39.342905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 443/882] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:39.350853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:39.461407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89379531-821e-4e88-aae7-7967b1659d8f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:39.479309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:39.496399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:39.497036 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:39.497368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:39.497632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:39.506218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:39.507647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:39.519903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:39.520824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:39.521780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 440/883] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:05:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:39.529025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:39.551641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:39.640209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a07802-83ac-4e5c-ba2f-96dad93a59c7 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:39.676422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f10101-9997-4ca2-b15d-b4e8df9096f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:39.677043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10101-9997-4ca2-b15d-b4e8df9096f1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:39.677321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10101-9997-4ca2-b15d-b4e8df9096f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:39.677590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f10101-9997-4ca2-b15d-b4e8df9096f1 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:39.678398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f10101-9997-4ca2-b15d-b4e8df9096f1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:39.678700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f10101-9997-4ca2-b15d-b4e8df9096f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:39.680123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f10101-9997-4ca2-b15d-b4e8df9096f1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:39.698369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 444/884] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 18:05:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:39.704528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:39.815671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f19313-583a-435f-9a90-b7154f34de87 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:39.851811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:39.852828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:39.853313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:39.853819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:39.887345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587874-7895-4edc-9056-a7bbecef3b44 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:39.887648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587874-7895-4edc-9056-a7bbecef3b44 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:39.887922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5587874-7895-4edc-9056-a7bbecef3b44 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:39.890781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 445/885] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:39.894940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fd7f-9695-429e-a5b2-585b3e30da81 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:39.895247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fd7f-9695-429e-a5b2-585b3e30da81 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:39.895547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c433fd7f-9695-429e-a5b2-585b3e30da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:39.912051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:39.916248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c433fd7f-9695-429e-a5b2-585b3e30da81 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:39.917513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c433fd7f-9695-429e-a5b2-585b3e30da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:39.932982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:39.934818 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.007995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 446/886] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:40.032237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433fd7f-9695-429e-a5b2-585b3e30da81 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.043648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.064578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 441/887] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:39 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:05:40.069676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.169436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c433fd7f-9695-429e-a5b2-585b3e30da81 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.170630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.204281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9f017-0cac-4887-9b07-1c81ad244820 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.212546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.213404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.213855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.214710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.215485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.217387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:40.230046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:40.231263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:40.232287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:40.235201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 447/888] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:40.245798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.250872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853c87b-95c9-4938-914e-d398da604bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.251634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c87b-95c9-4938-914e-d398da604bd2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.252017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c87b-95c9-4938-914e-d398da604bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.252440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853c87b-95c9-4938-914e-d398da604bd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.264963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c87b-95c9-4938-914e-d398da604bd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.267009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9853c87b-95c9-4938-914e-d398da604bd2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-9853c87b-95c9-4938-914e-d398da604bd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:40.282622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:40.283688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:40.284875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:40.284875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:40.284875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:40.284875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:40.287535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 442/889] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:40.288781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5a083-f876-4ef8-8a38-76af240a3aa9 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.289068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5a083-f876-4ef8-8a38-76af240a3aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.289348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5a083-f876-4ef8-8a38-76af240a3aa9 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.290911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 443/890] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:40.291894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5a083-f876-4ef8-8a38-76af240a3aa9 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.326306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.364994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9e1cb8-61a5-4c21-a7f9-c194adc25245 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.400633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74de35b8-04e6-4776-a58e-9375a8889729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.401246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de35b8-04e6-4776-a58e-9375a8889729 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.401530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de35b8-04e6-4776-a58e-9375a8889729 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.401807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de35b8-04e6-4776-a58e-9375a8889729 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.402173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5a083-f876-4ef8-8a38-76af240a3aa9 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.402500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de35b8-04e6-4776-a58e-9375a8889729 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:40.402796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de35b8-04e6-4776-a58e-9375a8889729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.404397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74de35b8-04e6-4776-a58e-9375a8889729 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.409422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 448/891] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:40.410467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3022-8505-4001-8bcb-073c58a700f7 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.410749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3022-8505-4001-8bcb-073c58a700f7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.411025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69a3022-8505-4001-8bcb-073c58a700f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.429045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c69a3022-8505-4001-8bcb-073c58a700f7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:40.430262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c69a3022-8505-4001-8bcb-073c58a700f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:40.437892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.444062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.444679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.444956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.445223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.445955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:40.446258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.447612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.460826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 444/892] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:40.463392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.499584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 449/893] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:40.500940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a3022-8505-4001-8bcb-073c58a700f7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.579785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.581151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a6c51-4a4e-429f-b3b1-335a0522ac9b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.616025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.616645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.616746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69a3022-8505-4001-8bcb-073c58a700f7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.616927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.617199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.617903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:40.618208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.619583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.624342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 445/894] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:40.625709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.652179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22566f2c-cddd-4fce-85d1-1e38e94c92d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.652815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566f2c-cddd-4fce-85d1-1e38e94c92d9 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.653341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566f2c-cddd-4fce-85d1-1e38e94c92d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.653621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22566f2c-cddd-4fce-85d1-1e38e94c92d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.660262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566f2c-cddd-4fce-85d1-1e38e94c92d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.661695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22566f2c-cddd-4fce-85d1-1e38e94c92d9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-22566f2c-cddd-4fce-85d1-1e38e94c92d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:40.673442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:40.674827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 450/895] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046927e-ee7a-4cb5-81c5-9d240955c6a0 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.676135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046927e-ee7a-4cb5-81c5-9d240955c6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.676906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046927e-ee7a-4cb5-81c5-9d240955c6a0 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.681852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 451/896] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:40.681852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046927e-ee7a-4cb5-81c5-9d240955c6a0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.689549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.733622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facd79e6-b3b2-4a70-81b5-e4c9d986b2cf None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.767564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.768196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.768479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.768753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.769379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.770774 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:40.779747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:40.780986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:40.782367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 446/897] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:40.783153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.784504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046927e-ee7a-4cb5-81c5-9d240955c6a0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.811305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.820180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004b394-1c50-49f7-8e89-610504b42d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.820801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b394-1c50-49f7-8e89-610504b42d15 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.821083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b394-1c50-49f7-8e89-610504b42d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.821360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004b394-1c50-49f7-8e89-610504b42d15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.830438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004b394-1c50-49f7-8e89-610504b42d15 None admin] RBAC: Adding query filter params (interface=public, service_id=89c0d891e1bd47ca9e3c57c0ab50bd23, region_id=RegionOne) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:40.830438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004b394-1c50-49f7-8e89-610504b42d15 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.830438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004b394-1c50-49f7-8e89-610504b42d15 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.830438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 452/898] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/endpoints?service_id=89c0d891e1bd47ca9e3c57c0ab50bd23&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:40.830438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46d85-6b81-45a3-80ab-fc86598cfd1a None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.830438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46d85-6b81-45a3-80ab-fc86598cfd1a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.830936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c46d85-6b81-45a3-80ab-fc86598cfd1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.847465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a3c46d85-6b81-45a3-80ab-fc86598cfd1a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:40.848620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a3c46d85-6b81-45a3-80ab-fc86598cfd1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:40.885247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d98ff1-ada0-4bbe-bd2d-888bc9c353aa None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:40.901857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:40.917263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 453/899] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:40.918175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46d85-6b81-45a3-80ab-fc86598cfd1a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:40.918975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:40.919759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:40.920176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:40.920617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:40.921366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:40.921686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:40.923753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:40.942341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 447/900] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:40.942341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.034461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c46d85-6b81-45a3-80ab-fc86598cfd1a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.045642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36188eff-d21a-45b5-850c-52d3a6d836ee None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.055070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:41.068669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.069289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.069571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.069873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.070650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:41.070884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.072253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.076807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 454/901] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:41.077576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.084591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.085244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.085602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.085930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.086617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.087993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.094568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 448/902] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:40 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:05:41.095417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.158102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:41.202125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a4d88-2d9a-473d-9c69-6fca4f97feac None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.223704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19a4680-63fd-42ff-88d3-7bc809c4c69d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.239411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.240068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.240373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.240629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.241257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.242793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:41.254306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:41.255363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:41.256304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 455/903] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 27 18:05:41 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:41.257219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.270065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.270778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.271037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.271316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.272117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] RBAC: Adding query filter params (role.id=fceb6b99a80a415db7c7296d02138e0e, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8538be4294e842e58aca6881db9002e8) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:41.272444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.273898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.282329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 449/904] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:41 2022] GET /identity/v3/role_assignments?user.id=8538be4294e842e58aca6881db9002e8&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fceb6b99a80a415db7c7296d02138e0e => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:41.284079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.325696 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:41.389510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faeb144d-29ca-4bb0-83c6-30ab74a34df9 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.433604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.434382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.434731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.434978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2942e7ce-3fe8-4c0a-9c89-5babea81555d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.435098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.435824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:41.436198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.438047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.444959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:41.449812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 456/905] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:41 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:41.476942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.477939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.478472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.479120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.479887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:41.480247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.481669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.487450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 450/906] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:41 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:41.493896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.613275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bb188-3e7b-4acd-8ad0-1dc98b2ba96b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.627574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:41.649734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.650315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.650594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.650862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.651535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:41.651838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.653507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.659547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 457/907] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:41 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:41.665224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.770977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bf0bd4-fe21-4eca-9b61-8b8047c17a5d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.810886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5739a195-2606-4243-a34a-3ebf0d5dfb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.811912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a195-2606-4243-a34a-3ebf0d5dfb9c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.812437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a195-2606-4243-a34a-3ebf0d5dfb9c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.812981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5739a195-2606-4243-a34a-3ebf0d5dfb9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.814021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a195-2606-4243-a34a-3ebf0d5dfb9c None admin] RBAC: Adding query filter params (interface=public, service_id=ec1424f85d0a408994f7a843038f4698, region_id=RegionOne) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:41.814581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a195-2606-4243-a34a-3ebf0d5dfb9c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.816236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5739a195-2606-4243-a34a-3ebf0d5dfb9c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.822543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 451/908] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:05:41 2022] GET /identity/v3/endpoints?service_id=ec1424f85d0a408994f7a843038f4698&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:41.833874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:41.939772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53014054-94cc-450b-a023-c6cb2d5631cb None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:41.980274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045ed06-ac65-4ee0-a872-da0791883582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:41.980944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ed06-ac65-4ee0-a872-da0791883582 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:41.981240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ed06-ac65-4ee0-a872-da0791883582 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:41.981521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045ed06-ac65-4ee0-a872-da0791883582 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:41.982273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ed06-ac65-4ee0-a872-da0791883582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:41.983736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045ed06-ac65-4ee0-a872-da0791883582 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:41.991200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 458/909] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:41 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:05:43.182713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb14ab-1884-46e4-8519-0dd4e085c425 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.183266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb14ab-1884-46e4-8519-0dd4e085c425 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.183266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acb14ab-1884-46e4-8519-0dd4e085c425 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.184885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 452/910] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:43.190085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919016a-664b-4d3b-82c5-2169d0217ca8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.190519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919016a-664b-4d3b-82c5-2169d0217ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.190666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1919016a-664b-4d3b-82c5-2169d0217ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.208793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-1919016a-664b-4d3b-82c5-2169d0217ca8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:43.210002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1919016a-664b-4d3b-82c5-2169d0217ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:43.245245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:43.278258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 459/911] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:43.306307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb14ab-1884-46e4-8519-0dd4e085c425 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:43.347646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:43.389920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0cc4e-09ef-45d1-86ee-705520638a8a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.390628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0cc4e-09ef-45d1-86ee-705520638a8a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.391129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0cc4e-09ef-45d1-86ee-705520638a8a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.393013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 460/912] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:43.398191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e826d6-f751-4c37-b39e-93e9d3de051e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.398724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e826d6-f751-4c37-b39e-93e9d3de051e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.399219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e826d6-f751-4c37-b39e-93e9d3de051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.417004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acb14ab-1884-46e4-8519-0dd4e085c425 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:43.423560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-02e826d6-f751-4c37-b39e-93e9d3de051e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:43.425491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-02e826d6-f751-4c37-b39e-93e9d3de051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:43.452214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:43.452883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.453160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.453433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.454087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:43.455443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:43.464478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:43.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 27 18:05:43.466507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:43.471133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 453/913] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:43.472028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:43.528363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 461/914] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:43.550997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e826d6-f751-4c37-b39e-93e9d3de051e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:43.594065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:43.598770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fdf959-819e-44ea-a2c3-66b97f7cfd90 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:43.641322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fbf1b-8821-4f3c-a9a7-ac6bc09322b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:43.641906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fbf1b-8821-4f3c-a9a7-ac6bc09322b3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.642189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fbf1b-8821-4f3c-a9a7-ac6bc09322b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.642455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fbf1b-8821-4f3c-a9a7-ac6bc09322b3 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.643129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fbf1b-8821-4f3c-a9a7-ac6bc09322b3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:43.643429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fbf1b-8821-4f3c-a9a7-ac6bc09322b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:43.644788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fbf1b-8821-4f3c-a9a7-ac6bc09322b3 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:43.649954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 454/915] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:43.651129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9160f-85bd-4321-8080-f70425134825 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.651410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9160f-85bd-4321-8080-f70425134825 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.651684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a9160f-85bd-4321-8080-f70425134825 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.653299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 455/916] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:43.658418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9160f-85bd-4321-8080-f70425134825 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:43.663287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:43.666162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e826d6-f751-4c37-b39e-93e9d3de051e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:43.702051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9be1ff-5dc5-45ad-8ea1-da567d58f009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:43.703417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be1ff-5dc5-45ad-8ea1-da567d58f009 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.704040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be1ff-5dc5-45ad-8ea1-da567d58f009 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.704328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9be1ff-5dc5-45ad-8ea1-da567d58f009 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.715666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9be1ff-5dc5-45ad-8ea1-da567d58f009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-cf9be1ff-5dc5-45ad-8ea1-da567d58f009 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:43.721147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:43.722126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:43.722959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:43.727321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 462/917] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 18:05:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:43.728399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006933ba-3aed-44d1-88ea-8d1a0f412d17 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.728684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006933ba-3aed-44d1-88ea-8d1a0f412d17 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.728959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006933ba-3aed-44d1-88ea-8d1a0f412d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.746425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-006933ba-3aed-44d1-88ea-8d1a0f412d17 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:43.747604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-006933ba-3aed-44d1-88ea-8d1a0f412d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:43.772357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a9160f-85bd-4321-8080-f70425134825 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:43.807906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:43.808754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.809038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.809311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.810015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:43.810319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:43.811676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:43.821336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 456/918] 10.222.0.67 () {56 vars in 1114 bytes} [Wed Jul 27 18:05:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:43.821336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:43.825805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 463/919] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:43.826648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006933ba-3aed-44d1-88ea-8d1a0f412d17 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:43.868706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:43.922822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:43.933154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006933ba-3aed-44d1-88ea-8d1a0f412d17 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:43.946225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594dd52-6590-4c7f-a586-0803f3176f11 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:43.969679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:43.970323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.970602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.970870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.971569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:43.972931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:43.981611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:43.982310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:43.982589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:43.982861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:43.983572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:43.983867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:43.985831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:43.994053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 457/920] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 18:05:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:44.000120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.068375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 464/921] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:05:43 2022] POST /identity/v3/endpoints => generated 346 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:44.069714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.087490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:44.101877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20096957-a6db-4f71-a9c1-b8e61f750f7d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.148477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2959e-b532-4e09-8855-4512a80e2ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.149101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2959e-b532-4e09-8855-4512a80e2ac0 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.149379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2959e-b532-4e09-8855-4512a80e2ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.149649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2959e-b532-4e09-8855-4512a80e2ac0 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.150385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2959e-b532-4e09-8855-4512a80e2ac0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.151800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf2959e-b532-4e09-8855-4512a80e2ac0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.194772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9f9eb-b663-4ec0-aefe-95c891fa592a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.216566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 458/922] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:43 2022] POST /identity/v3/services => generated 241 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:44.220724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011b9f-bd6e-4175-8e1c-4c57d9f6cf04 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.221436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011b9f-bd6e-4175-8e1c-4c57d9f6cf04 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.222265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad011b9f-bd6e-4175-8e1c-4c57d9f6cf04 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.225151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 459/923] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:44.231349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9742d37-a00d-4a0d-813b-0e6ed0df7e3d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.231929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9742d37-a00d-4a0d-813b-0e6ed0df7e3d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.232398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9742d37-a00d-4a0d-813b-0e6ed0df7e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.241015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.241015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.241651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.242176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.258133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b9742d37-a00d-4a0d-813b-0e6ed0df7e3d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:44.259747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b9742d37-a00d-4a0d-813b-0e6ed0df7e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:44.260131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.261639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.264312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:44.279190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:44.280202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:44.281621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:44.281621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:44.281621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:44.281621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:44.281621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 465/924] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:44.289935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.354938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 460/925] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:44.378665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9742d37-a00d-4a0d-813b-0e6ed0df7e3d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.412515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18857ad-1290-4099-8dda-d7e1fd4a6384 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.449897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.450452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.450725 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.451105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.451865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:44.452252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.454183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.463694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:44.467468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 466/926] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:44.474278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.494882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9742d37-a00d-4a0d-813b-0e6ed0df7e3d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.534821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.535745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.536303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.536581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.537217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.538620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.539691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:44.551099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:44.553693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:44.554557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 461/927] 10.222.0.67 () {56 vars in 1132 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:44.558091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.600387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357d666-c68b-41e5-ac68-30a62ede8c6a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.648422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.649098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.649377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.649648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.658673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.660113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:44.672678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:44.673681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:44.674677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 467/928] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:44.679299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.687103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d514103-68a4-42ec-af6c-fe9f51922285 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.726888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.727753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.728190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.728641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.729589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:44.730075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.731579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.738034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 462/929] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:44.743902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.747228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:44.824669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5b84f6-b557-4f4b-847c-92c3e1f4407e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.844580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:44.853294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70fc106-ebdb-4794-ba48-0a803327975d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:44.874582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.875798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.876474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.877282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.878277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:44.879215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.881035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.895204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:44.896063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:44.896484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:44.896910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:44.897751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:44.898748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:44.900520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:44.906661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 468/930] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:44.907038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 463/931] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:44.912274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:44.913933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:45.001524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:45.015864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a804a1d-05cb-4ca0-ba87-20b0974e2136 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:45.047400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8dcd-6a9d-444a-9336-dfda3e74ea43 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:45.053652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:45.054870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:45.055308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:45.055682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:45.056839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:45.058368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:45.087230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:45.087916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:45.088195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:45.088462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:45.103531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:45.105051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:45.122560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:45.123679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:45.124938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:45.124938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:45.124938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:45.124938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:45.129805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 464/932] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:45.130599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:45.187152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 469/933] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:05:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:05:45.245617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1513919f-336f-4bea-aabf-d07fea95dbea None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:45.265992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:45.293620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:45.294291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:45.294619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:45.294888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:45.295587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:45.295883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:45.299383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:45.314674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 465/934] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:45.320533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:45.353779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:45.434641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53f931-6f39-4f74-b4df-4b76f684de15 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:45.473074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:45.474042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:45.474471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:45.474927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:45.482205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:45.483819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:45.495428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:45.496516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:45.497669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:45.500274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 470/935] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:45.506034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:45.608718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56308ee2-8385-4228-a6d1-428717f0ddf8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:45.644579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ce958-91af-41bd-8d8e-27f15b11449d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:45.645197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce958-91af-41bd-8d8e-27f15b11449d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:45.645470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce958-91af-41bd-8d8e-27f15b11449d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:45.645738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ce958-91af-41bd-8d8e-27f15b11449d None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:45.646504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce958-91af-41bd-8d8e-27f15b11449d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:45.646801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce958-91af-41bd-8d8e-27f15b11449d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:45.648206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ce958-91af-41bd-8d8e-27f15b11449d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:45.660628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 466/936] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:45.666602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:45.762319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:45.775831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0ade05-32a8-41e2-b113-0291eb7bb0e4 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:45.811999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c123da4-74b1-41b6-8fa8-027128d071d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:45.813578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123da4-74b1-41b6-8fa8-027128d071d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:45.814080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123da4-74b1-41b6-8fa8-027128d071d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:45.814765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c123da4-74b1-41b6-8fa8-027128d071d6 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8538be4294e842e58aca6881db9002e8/roles/fceb6b99a80a415db7c7296d02138e0e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:45.817229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c123da4-74b1-41b6-8fa8-027128d071d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=8538be4294e842e58aca6881db9002e8, role_id=fceb6b99a80a415db7c7296d02138e0e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:45.818911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c123da4-74b1-41b6-8fa8-027128d071d6 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:45.908104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 471/937] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:05:45 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8538be4294e842e58aca6881db9002e8/roles/fceb6b99a80a415db7c7296d02138e0e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:05:46.192532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ebd64-ae8b-4f35-8250-150651150a9c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.192720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ebd64-ae8b-4f35-8250-150651150a9c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.192977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721ebd64-ae8b-4f35-8250-150651150a9c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.194625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 467/938] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:46.199876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949c831-f94a-4c41-a7ef-609043d32af9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.200166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949c831-f94a-4c41-a7ef-609043d32af9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.200439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949c831-f94a-4c41-a7ef-609043d32af9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.219405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8949c831-f94a-4c41-a7ef-609043d32af9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:46.220573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8949c831-f94a-4c41-a7ef-609043d32af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:46.296496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 472/939] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:46.316610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ebd64-ae8b-4f35-8250-150651150a9c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:46.353344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:46.423957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721ebd64-ae8b-4f35-8250-150651150a9c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:46.431565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38222-61c3-43ee-936a-8c40a6c9a578 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.432481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38222-61c3-43ee-936a-8c40a6c9a578 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.432831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa38222-61c3-43ee-936a-8c40a6c9a578 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.434578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 473/940] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:46.440594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93268aed-e7df-44e0-8b3b-2c51f377609e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.440878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93268aed-e7df-44e0-8b3b-2c51f377609e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.441331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93268aed-e7df-44e0-8b3b-2c51f377609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.461278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-93268aed-e7df-44e0-8b3b-2c51f377609e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:46.462642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-93268aed-e7df-44e0-8b3b-2c51f377609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:46.465708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:46.466627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.467102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.467597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.469186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:46.470878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:46.473779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING keystone.server.flask.common [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 18:05:46.523601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.sql.core [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:05:46.523601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 18:05:46.523601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [parameters: {'id': '2aec6436f4684e7d8dd8d300f4a01d3e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 18:05:46.523601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80552) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2aec6436f4684e7d8dd8d300f4a01d3e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2aec6436f4684e7d8dd8d300f4a01d3e. Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:05:46.535008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result.read() Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 27 18:05:46.535894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application yield resource Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise self.value Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application session.commit() Jul 27 18:05:46.536850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:05:46.538298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:05:46.539448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application result.read() Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:05:46.540247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [parameters: {'id': '2aec6436f4684e7d8dd8d300f4a01d3e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:46.541120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:46.542042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2aec6436f4684e7d8dd8d300f4a01d3e. Jul 27 18:05:46.544062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.544895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 474/941] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:46.552083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 468/942] 10.222.0.67 () {60 vars in 1140 bytes} [Wed Jul 27 18:05:46 2022] POST /identity/v3/projects => generated 262 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:46.554162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93268aed-e7df-44e0-8b3b-2c51f377609e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:46.562862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:46.566387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:46.670312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:46.680143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93268aed-e7df-44e0-8b3b-2c51f377609e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:46.681284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c925e-eb58-46cd-85f1-ea025393895a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:46.723846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:46.724415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.724696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.724971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.725600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:46.727324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:46.728923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:46.730264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.730773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.731516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:46.736563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:46.737702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:46.738636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:46.742514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:46.743078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 469/943] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:46.744626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:46.745019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:46.759591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:46.760523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:46.761404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:46.768481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 475/944] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:46.770080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:46.841976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:46.869126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb625ce2-c601-4531-9015-55fff6513599 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:46.879199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658a94-1368-4b46-9538-1f348623fca0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:46.907936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:46.909102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.909578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.910103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.910964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:46.911543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:46.913196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:46.917265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:46.917854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:46.918142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:46.918419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:46.919135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:46.919442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:46.920866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:46.924023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 470/945] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:46.930605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:46.953791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 476/946] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:46 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:46.962575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:47.064493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89ad06a-924d-4642-b957-ef8cf107badd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:47.100679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:47.101508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.101814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.102093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.102784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:47.103088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:47.104592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:47.110695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 471/947] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:47.119379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:47.227278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46ff0f-b809-47cf-a7a9-c5b056a6880c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:47.254696 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:47.263198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b793d45-fb01-4469-b536-4b5c24887e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:47.264093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793d45-fb01-4469-b536-4b5c24887e76 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.264570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793d45-fb01-4469-b536-4b5c24887e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.265060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b793d45-fb01-4469-b536-4b5c24887e76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.266027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793d45-fb01-4469-b536-4b5c24887e76 None admin] RBAC: Adding query filter params (interface=public, service_id=c100479acc6e4cfea481be50c46e81e2, region_id=RegionOne) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:47.266551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793d45-fb01-4469-b536-4b5c24887e76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:47.268115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b793d45-fb01-4469-b536-4b5c24887e76 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:47.273733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 477/948] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:05:47 2022] GET /identity/v3/endpoints?service_id=c100479acc6e4cfea481be50c46e81e2&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:47.279306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:47.367070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee960f-00f9-434f-ac7b-8f9bd901d2a1 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.367261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee960f-00f9-434f-ac7b-8f9bd901d2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.367531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee960f-00f9-434f-ac7b-8f9bd901d2a1 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.369186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 478/949] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:47.374182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744d69-adbe-47de-b37f-9cd01a674772 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.374657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744d69-adbe-47de-b37f-9cd01a674772 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.374782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6744d69-adbe-47de-b37f-9cd01a674772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.378149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:47.391031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c4774a-3ddc-4ce7-bfd6-9096f677239e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:47.397511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d6744d69-adbe-47de-b37f-9cd01a674772 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:47.399492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d6744d69-adbe-47de-b37f-9cd01a674772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:47.431021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:47.431693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.431971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.432236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.432932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:47.434324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:47.441728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 472/950] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:47 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:05:47.494633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 479/951] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:47.517012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:47.636941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194e2225-fe6d-406f-af30-b7cb9591a77e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:47.674226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:47.674873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.675199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.675474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.676102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:47.677469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:47.686676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:47.687708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:47.688550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 473/952] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:47.694184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744d69-adbe-47de-b37f-9cd01a674772 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:47.796169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6744d69-adbe-47de-b37f-9cd01a674772 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:47.820281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:47.831881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d0a765-8d41-4ee8-bc60-8b4085802576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:47.832515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0a765-8d41-4ee8-bc60-8b4085802576 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.832793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0a765-8d41-4ee8-bc60-8b4085802576 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.833068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d0a765-8d41-4ee8-bc60-8b4085802576 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.833746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0a765-8d41-4ee8-bc60-8b4085802576 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:47.834077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0a765-8d41-4ee8-bc60-8b4085802576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:47.835499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d0a765-8d41-4ee8-bc60-8b4085802576 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:47.840960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 480/953] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:47.847316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:47.861717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:47.954173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c85ad78-2539-49d4-9dae-23a792b5918d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:47.982111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544598-202f-4e4d-b1c6-17afa1ecc76e None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.982397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544598-202f-4e4d-b1c6-17afa1ecc76e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.982674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9544598-202f-4e4d-b1c6-17afa1ecc76e None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.985585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 481/954] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:47.989844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd8ac-b0b6-45dd-9c82-17276bfda851 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.990130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd8ac-b0b6-45dd-9c82-17276bfda851 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.990403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cd8ac-b0b6-45dd-9c82-17276bfda851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.994274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:47.994897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:47.995180 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:47.995457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:47.996135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:47.996440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:47.997823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:48.003034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 474/955] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:48.015676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-888cd8ac-b0b6-45dd-9c82-17276bfda851 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:48.016987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-888cd8ac-b0b6-45dd-9c82-17276bfda851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:48.101936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 482/956] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:48.122157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:48.206026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:48.232673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d4cb00-bbf4-4367-bc60-b283e5eb5884 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:48.272046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:48.272699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:48.272980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:48.273256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:48.284769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:48.289988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:48.290937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:48.291797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:48.296957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 475/957] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 18:05:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:48.298361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd8ac-b0b6-45dd-9c82-17276bfda851 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:48.401243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cd8ac-b0b6-45dd-9c82-17276bfda851 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:48.418948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:48.437222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee05d7-a324-432b-801f-728783270021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:48.437872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee05d7-a324-432b-801f-728783270021 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:48.438159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee05d7-a324-432b-801f-728783270021 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:48.438437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee05d7-a324-432b-801f-728783270021 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:48.439145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee05d7-a324-432b-801f-728783270021 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:48.439453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee05d7-a324-432b-801f-728783270021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:48.440809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fee05d7-a324-432b-801f-728783270021 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:48.452782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 483/958] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 18:05:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:48.459086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:48.569079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31afcd1d-f63f-46a5-925d-8ebfd4cad34a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:48.604590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:48.605586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:48.606099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:48.606574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:48.608820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:48.619264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:48.620956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:48.636033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:48.636977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:48.639386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:48.639386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:48.639386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:48.639386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:48.641332 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 476/959] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:48.653806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee05d7-a324-432b-801f-728783270021 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:48.758154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee05d7-a324-432b-801f-728783270021 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:48.793628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:48.794282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:48.794561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:48.794835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:48.795523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:48.795822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:48.797747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:48.810381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 484/960] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:48.815835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:48.927053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beaa32-988a-42ad-ab7d-1853ae229356 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:48.962953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:48.963981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:48.964468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:48.964968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:48.973908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:48.975578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:48.987315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:48.988353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 27 18:05:48.989319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:48.991910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 477/961] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:05:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:48.997791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.039598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:49.107010 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f4efb-f6e2-4810-93c2-dc295f426456 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:49.142482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a066b1-fac5-4d45-ae73-9edb32416993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:49.143106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a066b1-fac5-4d45-ae73-9edb32416993 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.143388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a066b1-fac5-4d45-ae73-9edb32416993 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.143660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a066b1-fac5-4d45-ae73-9edb32416993 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.144453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a066b1-fac5-4d45-ae73-9edb32416993 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:49.144758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a066b1-fac5-4d45-ae73-9edb32416993 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:49.146288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a066b1-fac5-4d45-ae73-9edb32416993 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:49.165230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 485/962] 10.222.0.67 () {56 vars in 1149 bytes} [Wed Jul 27 18:05:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:49.170742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.216439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ff1a-f6da-472f-909c-5b32124ce5d5 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.216750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ff1a-f6da-472f-909c-5b32124ce5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.216993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e9ff1a-f6da-472f-909c-5b32124ce5d5 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.219168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 486/963] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:49.224073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23ad1-e768-4fca-8cd6-315f92abba06 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.224359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23ad1-e768-4fca-8cd6-315f92abba06 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.224643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae23ad1-e768-4fca-8cd6-315f92abba06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.224761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:49.244341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-0ae23ad1-e768-4fca-8cd6-315f92abba06 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:49.245540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0ae23ad1-e768-4fca-8cd6-315f92abba06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:49.295483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92080c1d-c736-402c-b3fb-5427de5b150e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:49.336519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 487/964] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:49.349960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c2615-081b-402a-9592-987354a8f1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:49.350758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2615-081b-402a-9592-987354a8f1c7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.351179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2615-081b-402a-9592-987354a8f1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.351608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2615-081b-402a-9592-987354a8f1c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.362162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae23ad1-e768-4fca-8cd6-315f92abba06 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.389406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:49.433675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c2615-081b-402a-9592-987354a8f1c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:49.435376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c2615-081b-402a-9592-987354a8f1c7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:49.464821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae23ad1-e768-4fca-8cd6-315f92abba06 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:49.484862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:49.500893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:49.501489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.501809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.502072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.502746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:49.504476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:49.507170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING keystone.server.flask.common [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 27 18:05:49.545017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 478/965] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:05:49 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:05:49.550342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e087-616a-451d-917a-4ee3837e3820 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.550670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e087-616a-451d-917a-4ee3837e3820 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.550944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c730e087-616a-451d-917a-4ee3837e3820 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.552243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 479/966] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:49.553023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e087-616a-451d-917a-4ee3837e3820 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.562315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.sql.core [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:05:49.562315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 18:05:49.562315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [parameters: {'user_id': '7b455a0d9c4f456cb60ad8c2633aa6fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 18:05:49.562315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80553) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-31ae7e82-ae58-42ba-9798-861e217796aa None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application result.read() Jul 27 18:05:49.579289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:05:49.580410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application yield resource Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application next(self.gen) Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self.session.rollback() Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self.force_reraise() Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise self.value Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application session.commit() Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 27 18:05:49.581383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._prepare_impl() Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self.session.flush() Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._flush(objects) Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application compat.raise_( Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application flush_context.execute() Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rec.execute(self) Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 27 18:05:49.582315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 27 18:05:49.583200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application result = self._query(query) Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application conn.query(q) Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application result.read() Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 27 18:05:49.584362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [parameters: {'user_id': '7b455a0d9c4f456cb60ad8c2633aa6fa', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:49.585278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 27 18:05:49.588275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 488/967] 10.222.0.67 () {60 vars in 1131 bytes} [Wed Jul 27 18:05:49 2022] POST /identity/v3/users => generated 160 bytes in 219 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb119b3-22e4-4def-b9e4-8a51b27dc9ee None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb119b3-22e4-4def-b9e4-8a51b27dc9ee None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.590825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb119b3-22e4-4def-b9e4-8a51b27dc9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.602367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-acb119b3-22e4-4def-b9e4-8a51b27dc9ee None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:49.603915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-acb119b3-22e4-4def-b9e4-8a51b27dc9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:49.672121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c730e087-616a-451d-917a-4ee3837e3820 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:49.679784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 489/968] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:49.681180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb119b3-22e4-4def-b9e4-8a51b27dc9ee None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.700374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:49.715914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:49.716858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.717350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.717684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.729234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:49.730705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:49.737734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:49.747328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:49.748508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:49.749431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:49.749431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:49.749431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:49.749431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:49.749431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 480/969] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:49.749431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.787645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb119b3-22e4-4def-b9e4-8a51b27dc9ee None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:49.824574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:49.825412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.825700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.826003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.835615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:49.838019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:49.853883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:49.854839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:49.855798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 490/970] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:05:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:49.856407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.861320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25102370-20dd-48cd-b979-aee658338d3d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:49.897718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:49.898510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:49.898787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:49.899061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:49.899683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:49.901217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:49.912082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:49.913105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:49.914008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 481/971] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:49.915436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:49.949056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:49.971298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac7c62-2a37-47eb-9227-74902c9d6b0a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:49.978181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:50.006740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.007367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.007648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.007917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.008594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:50.008894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.010296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.018503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449069c6-bfb0-4fac-9c6a-217ca1e22995 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.025810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 491/972] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:50.026818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:50.065819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.067103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.067566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.067988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.069264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:50.070056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.071923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.117073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 482/973] 10.222.0.67 () {56 vars in 1101 bytes} [Wed Jul 27 18:05:49 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:50.118209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:50.142113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44534a4-192f-4251-b053-eb0ae69163bc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.193225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c70fe-6ea0-4dc8-a085-bbf4c6a2ac88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.194368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c70fe-6ea0-4dc8-a085-bbf4c6a2ac88 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.194856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c70fe-6ea0-4dc8-a085-bbf4c6a2ac88 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.195330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c70fe-6ea0-4dc8-a085-bbf4c6a2ac88 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.196508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c70fe-6ea0-4dc8-a085-bbf4c6a2ac88 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:50.197746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c70fe-6ea0-4dc8-a085-bbf4c6a2ac88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.200280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c70fe-6ea0-4dc8-a085-bbf4c6a2ac88 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.206601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 492/974] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:50.208207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336ab9-cd68-4ee2-913d-366978cdf498 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.208693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336ab9-cd68-4ee2-913d-366978cdf498 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.209152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c336ab9-cd68-4ee2-913d-366978cdf498 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.210761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 493/975] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:50.212251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c336ab9-cd68-4ee2-913d-366978cdf498 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:50.218891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:50.242325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56af32-438a-4058-8c23-723791eaea81 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.270118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:50.287515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc253311-e789-401e-89f0-021effaab90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.288166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253311-e789-401e-89f0-021effaab90b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.288446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253311-e789-401e-89f0-021effaab90b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.288720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc253311-e789-401e-89f0-021effaab90b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.295578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc253311-e789-401e-89f0-021effaab90b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.297607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc253311-e789-401e-89f0-021effaab90b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-dc253311-e789-401e-89f0-021effaab90b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:05:50.310940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:50.311866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:05:50.312763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:50.317532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 483/976] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:50.318937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db96cd-050c-4b81-b6de-13b20a128331 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.319232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db96cd-050c-4b81-b6de-13b20a128331 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.319544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db96cd-050c-4b81-b6de-13b20a128331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.333370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c336ab9-cd68-4ee2-913d-366978cdf498 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.340915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-26db96cd-050c-4b81-b6de-13b20a128331 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:50.342496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-26db96cd-050c-4b81-b6de-13b20a128331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:50.374738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.375524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.375885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.376072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.376790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:50.377093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.378501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.383659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 494/977] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:50.384457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:50.417234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 484/978] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:50.418339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db96cd-050c-4b81-b6de-13b20a128331 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:50.453309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:50.486826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5105ca9-2ae3-4ada-a6c8-1a264ae2d7f1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.514092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db96cd-050c-4b81-b6de-13b20a128331 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.519684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.520369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.520715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.521054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.521888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:50.522194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.523614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.525238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:50.536361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 495/979] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:05:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:50.537180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:50.549834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.550456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.550737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.551019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.551724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.553079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.625856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 485/980] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:05:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:50.626419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:50.648084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f48c-87ac-484f-9934-135d7896ea3a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.680151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:50.699651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cb6362-8856-49d1-a2c5-4790ae64b905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.701256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6362-8856-49d1-a2c5-4790ae64b905 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.701979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6362-8856-49d1-a2c5-4790ae64b905 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.702450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cb6362-8856-49d1-a2c5-4790ae64b905 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.704064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6362-8856-49d1-a2c5-4790ae64b905 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.705479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cb6362-8856-49d1-a2c5-4790ae64b905 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.751221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35894f87-0753-4556-b7c4-bfa5bf24735d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:50.788627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9047da09-e2a7-44f8-969b-57c885da9a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:50.789296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047da09-e2a7-44f8-969b-57c885da9a07 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:50.789784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047da09-e2a7-44f8-969b-57c885da9a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:50.789914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 496/981] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:50 2022] POST /identity/v3/services => generated 242 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:50.789996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047da09-e2a7-44f8-969b-57c885da9a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:50.790703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047da09-e2a7-44f8-969b-57c885da9a07 None admin] RBAC: Adding query filter params (role.id=fceb6b99a80a415db7c7296d02138e0e, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8538be4294e842e58aca6881db9002e8) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:50.790993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047da09-e2a7-44f8-969b-57c885da9a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:50.792428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9047da09-e2a7-44f8-969b-57c885da9a07 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:50.799991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 486/982] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:05:50 2022] GET /identity/v3/role_assignments?user.id=8538be4294e842e58aca6881db9002e8&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fceb6b99a80a415db7c7296d02138e0e => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:52.697927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673efd-ba68-41e4-8997-7ddaf489b0cb None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:52.698446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673efd-ba68-41e4-8997-7ddaf489b0cb None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:52.698526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69673efd-ba68-41e4-8997-7ddaf489b0cb None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:52.699885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 497/983] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:52.705066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf310b8-1cfa-4362-a24b-55a7bda4fca5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:52.705485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf310b8-1cfa-4362-a24b-55a7bda4fca5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:52.705691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf310b8-1cfa-4362-a24b-55a7bda4fca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:52.723694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-faf310b8-1cfa-4362-a24b-55a7bda4fca5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:52.724875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-faf310b8-1cfa-4362-a24b-55a7bda4fca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:52.750254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:52.801503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 487/984] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:52.823808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673efd-ba68-41e4-8997-7ddaf489b0cb None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:52.836155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f1ff-6b94-47b1-b289-8bf64c7bb14a None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:52.836428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f1ff-6b94-47b1-b289-8bf64c7bb14a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:52.836706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9f1ff-6b94-47b1-b289-8bf64c7bb14a None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:52.841080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 488/985] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:52.842434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa456d-64c7-4f7c-8d1a-99e683db4cb2 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:52.842719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa456d-64c7-4f7c-8d1a-99e683db4cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:52.843048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa456d-64c7-4f7c-8d1a-99e683db4cb2 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:52.844339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 489/986] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:52.845376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505087c-6601-40ac-910e-b63774c92ccb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:52.845631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505087c-6601-40ac-910e-b63774c92ccb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:52.845945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505087c-6601-40ac-910e-b63774c92ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:52.864063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4505087c-6601-40ac-910e-b63774c92ccb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:52.865268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4505087c-6601-40ac-910e-b63774c92ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:52.930732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69673efd-ba68-41e4-8997-7ddaf489b0cb None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:52.931711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 490/987] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:52.932926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7c87-164b-4fa7-8077-84e33bf8d59f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:52.933207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7c87-164b-4fa7-8077-84e33bf8d59f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:52.933481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f7c87-164b-4fa7-8077-84e33bf8d59f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:52.951345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-753f7c87-164b-4fa7-8077-84e33bf8d59f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:52.952602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-753f7c87-164b-4fa7-8077-84e33bf8d59f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:52.968684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:52.969308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:52.969585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:52.969878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:52.970498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:52.971839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:52.980385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:52.981482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:52.982356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 498/988] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:52.983167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.020906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 491/989] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:52 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:53.021731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7c87-164b-4fa7-8077-84e33bf8d59f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.028357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.042684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.080058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf94d0b-162f-423a-9dcd-ff9641ecf52f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.114281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.114467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.114749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.115019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.115646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.117007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.126322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f7c87-164b-4fa7-8077-84e33bf8d59f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:53.126727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:53.127806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:53.128643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 499/990] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:53.129452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.165627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.166274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.166555 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.166827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.167503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.167803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.169158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.174594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 492/991] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.175212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.226667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d78496-ec60-435f-b70d-254859de549b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.237140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.252628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.259844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.264664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.264664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.264664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] PATH_INFO: `/v3/services/image` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.264664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.264664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.270579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1223169-c686-4aeb-90b6-91d1d13c2c69 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:53.271623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:53.272607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:05:53.273445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:53.277959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 500/992] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services/image => generated 86 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:53.278923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.305208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.305912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.306199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.306469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.307127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.307429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.308778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.314824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 493/993] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.315601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.378823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3739d-60ca-4e81-8bbd-c667cbc834dc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.412873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.413489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.413791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.414071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.414739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.415054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.415288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42723b-c1c1-4426-ac3b-4c68013c8750 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.416397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.421337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 501/994] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.422030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.454040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.454654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.454938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.455208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.455924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] RBAC: Adding query filter params (name=image) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.456228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.457583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.461060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.462415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 494/995] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.463210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.474492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.521286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daca6a7b-8a19-444b-aa1f-d50249f23978 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.555131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.555746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.556015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.556281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.556945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.557243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.558624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.562195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b98a54-2aef-42ba-a43b-09b992368d36 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.564591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 502/996] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.565377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.597061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.597676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.597987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.598263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.599017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] RBAC: Adding query filter params (interface=admin, service_id=c100479acc6e4cfea481be50c46e81e2, region_id=RegionOne) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.599324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.600685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.605611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 495/997] 10.222.0.67 () {56 vars in 1249 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/endpoints?service_id=c100479acc6e4cfea481be50c46e81e2&interface=admin®ion_id=RegionOne => generated 193 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.606410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.667577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6d5a6a-528c-4cf3-85e7-0d4f60f70836 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.669068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.674822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.700830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.701446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.701792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.702073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.702822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] RBAC: Adding query filter params (type=image) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.703124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.704534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.705366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc7684-a191-4edb-b8dc-0ab5146d216d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.721793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 503/998] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.721793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.743115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.743752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.744031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.744340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.745425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] RBAC: Adding query filter params (interface=public, service_id=acc2d0928ed74b5c9fb8fabd38a85093, region_id=RegionOne) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:53.745736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.747267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.753429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 496/999] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/endpoints?service_id=acc2d0928ed74b5c9fb8fabd38a85093&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:53.759370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:53.843656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d73ab85-c510-46eb-aac4-23627ed66287 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.878400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1dfe14-e72b-4b38-97e8-71ed2f8e0837 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:53.885056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f006692-9951-445c-ab17-00795fe75975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.885687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006692-9951-445c-ab17-00795fe75975 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.886027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006692-9951-445c-ab17-00795fe75975 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.886283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006692-9951-445c-ab17-00795fe75975 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.886933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006692-9951-445c-ab17-00795fe75975 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.888301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f006692-9951-445c-ab17-00795fe75975 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.895337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 504/1000] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services => generated 1727 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:05:53.921695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c03eea8-5bda-464b-9a0d-c3fd9b2f38d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:53.922373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03eea8-5bda-464b-9a0d-c3fd9b2f38d7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:53.922652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03eea8-5bda-464b-9a0d-c3fd9b2f38d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:53.922925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c03eea8-5bda-464b-9a0d-c3fd9b2f38d7 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:53.923594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03eea8-5bda-464b-9a0d-c3fd9b2f38d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:53.924996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c03eea8-5bda-464b-9a0d-c3fd9b2f38d7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:53.927723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:53.933159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 497/1001] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:53 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:05:55.709530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a061-46fa-4b9e-b96a-0e89f3b54038 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:55.710096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a061-46fa-4b9e-b96a-0e89f3b54038 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:55.710096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e51a061-46fa-4b9e-b96a-0e89f3b54038 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:55.711618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 505/1002] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:55.716484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166947d-1d76-4a90-a6fd-7f5a40234a27 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:55.716891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166947d-1d76-4a90-a6fd-7f5a40234a27 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:55.717068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166947d-1d76-4a90-a6fd-7f5a40234a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:55.736136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-f166947d-1d76-4a90-a6fd-7f5a40234a27 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:55.737309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f166947d-1d76-4a90-a6fd-7f5a40234a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:55.805349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 498/1003] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:55.827436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51a061-46fa-4b9e-b96a-0e89f3b54038 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:55.860249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:55.931803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e51a061-46fa-4b9e-b96a-0e89f3b54038 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:55.944250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ad8d-a773-4572-9638-c25cf81202f3 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:55.944527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ad8d-a773-4572-9638-c25cf81202f3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:55.944792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9ad8d-a773-4572-9638-c25cf81202f3 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:55.946525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 499/1004] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:55.951004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf33e-93c7-468a-9724-7cdbbd7139aa None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:55.951284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf33e-93c7-468a-9724-7cdbbd7139aa None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:55.951610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf33e-93c7-468a-9724-7cdbbd7139aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:55.969826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:55.970366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:55.970644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:55.970738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-abbbf33e-93c7-468a-9724-7cdbbd7139aa None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:55.970913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:55.971604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:55.971922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-abbbf33e-93c7-468a-9724-7cdbbd7139aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:55.972969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.038193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 500/1005] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:56.039594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c94ee-6afe-4334-ad7a-88b73b8c8aff None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.039877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c94ee-6afe-4334-ad7a-88b73b8c8aff None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.040150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6c94ee-6afe-4334-ad7a-88b73b8c8aff None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.041419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 501/1006] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:56.047188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c46dd-4d1f-405d-ad2f-1194df401bbc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.047463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c46dd-4d1f-405d-ad2f-1194df401bbc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.047734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c46dd-4d1f-405d-ad2f-1194df401bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.060356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 506/1007] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:55 2022] POST /identity/v3/services => generated 242 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:56.061382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.067391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c26c46dd-4d1f-405d-ad2f-1194df401bbc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:56.068631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c26c46dd-4d1f-405d-ad2f-1194df401bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:56.142231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:56.169809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 502/1008] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:56 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:56.170042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:56.179999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aeab2d-db9a-41f1-a2bb-e31c1f1e122f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.189431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c46dd-4d1f-405d-ad2f-1194df401bbc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.220354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.220689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.220878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.221153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.221878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.223232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:56.234180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:56.235213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:56.236091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 507/1009] 10.222.0.67 () {56 vars in 1126 bytes} [Wed Jul 27 18:05:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:56.242078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.309070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26c46dd-4d1f-405d-ad2f-1194df401bbc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.347415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.348062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.348339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.348704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.349236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.350728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.353975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b1758f-de24-4bc5-a58b-d0c5e3993005 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:56.359841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:56.360817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:56.361796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 503/1010] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:05:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:56.367214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.393160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.393973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.394269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.394875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.395840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:56.398585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.398585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.404115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 508/1011] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:56.410308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.423921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:56.429412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:56.479184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc71013-9335-4286-af32-750e87e26925 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.512847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.513468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.513837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.514056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.515315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:56.515630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.515798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7147ca6-00d9-49ae-9cbb-81a2ae627013 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.517000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.526657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 504/1012] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:56.527941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.559812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.560873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.561444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.561817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.562473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:56.562814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.565532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.575335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 509/1013] 10.222.0.67 () {56 vars in 1122 bytes} [Wed Jul 27 18:05:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:56.576272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.639151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96ddd4-0892-499e-b3a0-177b67788450 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.653857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:56.663219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:56.674743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.675363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.675645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.675921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.676595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:56.676902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.678295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.682580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83ad125-4ce8-4bf1-bbf5-6273cd8f33d3 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.688393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 505/1014] 10.222.0.67 () {56 vars in 1112 bytes} [Wed Jul 27 18:05:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:56.690069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:56.720710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c81d46e-19c6-4fc0-b06c-69841c6ccb4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.721336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d46e-19c6-4fc0-b06c-69841c6ccb4b None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.721619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d46e-19c6-4fc0-b06c-69841c6ccb4b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.721930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c81d46e-19c6-4fc0-b06c-69841c6ccb4b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.722624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d46e-19c6-4fc0-b06c-69841c6ccb4b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.723981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c81d46e-19c6-4fc0-b06c-69841c6ccb4b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.794182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38de51-1739-4bea-a4d8-9954353e65f4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:56.803511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 510/1015] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:05:56 2022] POST /identity/v3/endpoints => generated 325 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:56.842478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7ef979-9f6d-41cb-8f99-b0d0e252e652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:56.843136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef979-9f6d-41cb-8f99-b0d0e252e652 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:56.843692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef979-9f6d-41cb-8f99-b0d0e252e652 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:56.844132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7ef979-9f6d-41cb-8f99-b0d0e252e652 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:56.845405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef979-9f6d-41cb-8f99-b0d0e252e652 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:56.847468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7ef979-9f6d-41cb-8f99-b0d0e252e652 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:56.918015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 506/1016] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:05:56 2022] POST /identity/v3/endpoints => generated 334 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:05:58.105147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6958f-460a-4c0f-bf86-816ef5f2ae61 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.105671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6958f-460a-4c0f-bf86-816ef5f2ae61 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.105671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae6958f-460a-4c0f-bf86-816ef5f2ae61 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.107141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 511/1017] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:58.114834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8207-af1d-4007-be39-9324ef3d22c3 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.115248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8207-af1d-4007-be39-9324ef3d22c3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.115409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca8207-af1d-4007-be39-9324ef3d22c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.133739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4cca8207-af1d-4007-be39-9324ef3d22c3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:58.134949 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4cca8207-af1d-4007-be39-9324ef3d22c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:58.159670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:58.208858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 507/1018] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:58.230669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6958f-460a-4c0f-bf86-816ef5f2ae61 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:58.335167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae6958f-460a-4c0f-bf86-816ef5f2ae61 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:58.368189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:58.368752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.369030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.369304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] PATH_INFO: `/v3/services/image` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.369950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:58.371368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:58.380603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:58.381618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:05:58.382493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:58.383864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 512/1019] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 27 18:05:58 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:58.387862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca8207-af1d-4007-be39-9324ef3d22c3 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:58.488259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca8207-af1d-4007-be39-9324ef3d22c3 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:58.523470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:58.524392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.524881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.525334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.526305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] RBAC: Adding query filter params (name=image) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:58.526790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:58.528579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:58.538136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 508/1020] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:58.539426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:58.549503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:58.642242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2f0d3-895e-4dd0-bd03-d546e9b4f587 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:58.676532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20adc71-9653-4310-a64a-3b5001ac0dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:58.677516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20adc71-9653-4310-a64a-3b5001ac0dee None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.678039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20adc71-9653-4310-a64a-3b5001ac0dee None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.678531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20adc71-9653-4310-a64a-3b5001ac0dee None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.679396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20adc71-9653-4310-a64a-3b5001ac0dee None admin] RBAC: Adding query filter params (type=image) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:58.679898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20adc71-9653-4310-a64a-3b5001ac0dee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:58.681544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20adc71-9653-4310-a64a-3b5001ac0dee None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:58.687247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 513/1021] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:58.693226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:58.715913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:58.794870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b160c-9498-41bf-98d3-38b3654e9084 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:58.815097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514b68-a485-4324-909b-054f5e96e9c8 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.815704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514b68-a485-4324-909b-054f5e96e9c8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.816180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af514b68-a485-4324-909b-054f5e96e9c8 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.818014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 514/1022] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:05:58.822936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33d13-7cf0-4e53-9c93-f10181fc214d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.823238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33d13-7cf0-4e53-9c93-f10181fc214d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.823488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda33d13-7cf0-4e53-9c93-f10181fc214d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.831428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:58.832333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.832813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.833286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.834285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] RBAC: Adding query filter params (interface=public, service_id=88f8744d2cff441d9c5d158f5ce9930a, region_id=RegionOne) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:58.834807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:58.836353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:58.841380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-cda33d13-7cf0-4e53-9c93-f10181fc214d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:58.842611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cda33d13-7cf0-4e53-9c93-f10181fc214d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:58.846128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 509/1023] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:05:58 2022] GET /identity/v3/endpoints?service_id=88f8744d2cff441d9c5d158f5ce9930a&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:58.847154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:58.907740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:58.912736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 515/1024] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:05:58.935766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda33d13-7cf0-4e53-9c93-f10181fc214d None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:58.939227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:58.957439 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22215573-51c7-4b78-ad4d-9b3b3848248d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:58.996139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f11261-207b-4bf5-a8f2-4640eba321de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:58.996852 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f11261-207b-4bf5-a8f2-4640eba321de None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:58.997128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f11261-207b-4bf5-a8f2-4640eba321de None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:58.997397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f11261-207b-4bf5-a8f2-4640eba321de None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:58.998077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f11261-207b-4bf5-a8f2-4640eba321de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:58.999516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f11261-207b-4bf5-a8f2-4640eba321de None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:59.010072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 510/1025] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:05:58 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:05:59.011403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1086cd-cea3-402c-8b66-3feee0024e39 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.011640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1086cd-cea3-402c-8b66-3feee0024e39 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.011913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1086cd-cea3-402c-8b66-3feee0024e39 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.013602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 511/1026] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:05:59.019491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae3d4-cbe0-4e13-ad87-2347f2a27df9 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.019806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae3d4-cbe0-4e13-ad87-2347f2a27df9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.020046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae3d4-cbe0-4e13-ad87-2347f2a27df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.039926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-1e3ae3d4-cbe0-4e13-ad87-2347f2a27df9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:05:59.041297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1e3ae3d4-cbe0-4e13-ad87-2347f2a27df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:05:59.045661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda33d13-7cf0-4e53-9c93-f10181fc214d None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:59.083599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:59.084256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.084534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.084803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.086039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:59.087504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:59.089381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 516/1027] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:59.096013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:59.128583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 512/1028] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:05:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:05:59.151280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae3d4-cbe0-4e13-ad87-2347f2a27df9 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:59.176037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:59.211950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89292d45-915d-40f1-a0b8-30f1a831f39d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:59.239894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:59.251057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:59.251676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.252019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.252257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.252944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:59.254375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:59.261082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae3d4-cbe0-4e13-ad87-2347f2a27df9 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:59.296877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:59.297601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.297905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.298177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.308114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:05:59.313264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:59.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:05:59.315415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 513/1029] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 18:05:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:59.320468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:59.358559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 517/1030] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:05:59 2022] POST /identity/v3/projects => generated 311 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:05:59.438114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b0ec6d-cedc-4ce7-8fbf-5d730048655d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:59.477497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:59.478173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.478450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.478719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.479445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:59.479748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:59.481130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:59.487119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:59.495164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 514/1031] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 18:05:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:05:59.497736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:59.602716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d62a69-4fa7-4cab-bca5-5da641e45f73 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:59.623284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:05:59.638411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:59.639061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.639373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.639652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.649699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:59.651174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:05:59.667605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:59.669952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:59.671444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:05:59.671444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:05:59.671444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:05:59.671444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:59.671444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 518/1032] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:05:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:05:59.675500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:59.774325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97d2b83-aabf-4ea8-98cb-97cc681d52e3 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:59.807856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:59.808464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.808737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.809004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.809679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:05:59.810004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:59.811386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:59.827682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 515/1033] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:05:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:05:59.828912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:05:59.933982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17675d4e-fc73-47fd-8994-8b591ff8df5b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:05:59.970519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:05:59.971157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:05:59.971438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:05:59.971709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] PATH_INFO: `/v3/users/nova` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:05:59.978782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:05:59.980221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:05:59.992261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:05:59.993214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:05:59.994609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:05:59.995522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 519/1034] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:05:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:05:59.999478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:00.060120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:00.107125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d979de1-0e13-47ac-acab-052bc88ed856 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:00.147999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:00.148655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:00.148905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:00.149143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:00.149955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:00.150261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:00.151675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:00.177258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 516/1035] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:05:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:00.178774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:00.211878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:00.280609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d591207-10cc-4772-92c6-aa04e7d058be None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:00.313873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:00.314377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:00.314660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:00.314935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:00.380788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:00.382267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:00.412728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:00.487152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 520/1036] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:00 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:00.491871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:00.598816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf35c9-cbe7-415e-8e58-5744eea4c980 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:00.616856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:00.634561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823159-70b4-4295-a355-315216929485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:00.635270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823159-70b4-4295-a355-315216929485 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:00.635550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823159-70b4-4295-a355-315216929485 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:00.635849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85823159-70b4-4295-a355-315216929485 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:00.647244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823159-70b4-4295-a355-315216929485 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:00.648686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85823159-70b4-4295-a355-315216929485 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-85823159-70b4-4295-a355-315216929485 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:06:00.663709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:00.664598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:00.665487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:06:00.665487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:06:00.665487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:00.665487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:00.669782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 517/1037] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:00.671041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:00.773287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebc64de-51bc-4973-b11b-868a900a0952 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:00.801693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:00.807138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:00.807757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:00.808033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:00.808303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:00.808983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:00.809281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:00.810687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:00.827702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 521/1038] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:00.828969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823159-70b4-4295-a355-315216929485 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:00.932674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85823159-70b4-4295-a355-315216929485 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:00.966593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7128df-c441-432e-8bdc-30d27e39fdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:00.967237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7128df-c441-432e-8bdc-30d27e39fdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:00.968040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7128df-c441-432e-8bdc-30d27e39fdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:00.968311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7128df-c441-432e-8bdc-30d27e39fdf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:00.975078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7128df-c441-432e-8bdc-30d27e39fdf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:00.976508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7128df-c441-432e-8bdc-30d27e39fdf4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-5f7128df-c441-432e-8bdc-30d27e39fdf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:06:00.987775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:00.988665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:06:00.989554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:00.993815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 518/1039] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:06:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:00.994983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.052429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8922b-0edc-4e33-8986-618063195d9c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.052719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8922b-0edc-4e33-8986-618063195d9c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.053000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8922b-0edc-4e33-8986-618063195d9c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.054542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 519/1040] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:06:01.059248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf0ef-4670-4d52-aa7a-ac7e158d71fd None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.059536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf0ef-4670-4d52-aa7a-ac7e158d71fd None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.059813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225bf0ef-4670-4d52-aa7a-ac7e158d71fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.078148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-225bf0ef-4670-4d52-aa7a-ac7e158d71fd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:01.079253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-225bf0ef-4670-4d52-aa7a-ac7e158d71fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:01.105675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:01.106110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbd569-be55-48f7-9ff4-e60de89e8d4b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.147647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.148270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.148547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.148816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.149552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:01.149888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.151312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:01.163457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 520/1041] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:01.169431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 522/1042] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:06:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:01.170258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf0ef-4670-4d52-aa7a-ac7e158d71fd None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.185229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.245156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:01.274451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225bf0ef-4670-4d52-aa7a-ac7e158d71fd None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.298422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378130aa-0cfc-454f-93a3-994b8c7fb14b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.308132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.308746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.309029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.309335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.310127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] RBAC: Adding query filter params (role.id=fceb6b99a80a415db7c7296d02138e0e, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=4e107a27b86243dcbb160a3960682b2d) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:01.310433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.312407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:01.324894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 521/1043] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:01 2022] GET /identity/v3/role_assignments?user.id=4e107a27b86243dcbb160a3960682b2d&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fceb6b99a80a415db7c7296d02138e0e => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:01.342727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13b6373-af1a-46f7-9577-13b7787f8d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.343492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6373-af1a-46f7-9577-13b7787f8d5c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.343844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6373-af1a-46f7-9577-13b7787f8d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.344190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13b6373-af1a-46f7-9577-13b7787f8d5c None admin] PATH_INFO: `/v3/services/image` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.344904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b6373-af1a-46f7-9577-13b7787f8d5c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.346472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13b6373-af1a-46f7-9577-13b7787f8d5c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-b13b6373-af1a-46f7-9577-13b7787f8d5c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:01.356498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:01.357563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:01.364011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 523/1044] 10.222.0.67 () {56 vars in 1105 bytes} [Wed Jul 27 18:06:01 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:06:01.366277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.396495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:01.455560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a29ea0-43c3-4173-8e1d-9e1374985cca None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.455741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a29ea0-43c3-4173-8e1d-9e1374985cca None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.456014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a29ea0-43c3-4173-8e1d-9e1374985cca None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.457391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 524/1045] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:06:01.462793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d4ab-0aee-4a91-b2e8-98633e850412 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.463078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d4ab-0aee-4a91-b2e8-98633e850412 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.463345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e0d4ab-0aee-4a91-b2e8-98633e850412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.480223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2597-51a5-418b-bf96-397615cddfaa None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.483990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-16e0d4ab-0aee-4a91-b2e8-98633e850412 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:01.485206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-16e0d4ab-0aee-4a91-b2e8-98633e850412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:01.519715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.520335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.520611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.520885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.521543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:01.521868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.523221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:01.529302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 522/1046] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:01.535355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.561802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 525/1047] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:06:01.585442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0d4ab-0aee-4a91-b2e8-98633e850412 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.632426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:01.645964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:01.648528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816b0e6-6619-4833-b6bc-14f7abcf85a7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.685664 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.686859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.687136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.687408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.688073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] RBAC: Adding query filter params (type=image) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:01.688370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.689725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:01.699275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 523/1048] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:01.700312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.705421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e0d4ab-0aee-4a91-b2e8-98633e850412 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.741098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.741737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.742041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.742311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.743443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.744875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:01.746711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 526/1049] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:01.752681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:01.808804 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73935a-73a1-48f3-bb70-4d0fdecb0ebb None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.844775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bdd891-8ee1-4f33-b569-d05adf5dcd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.845401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdd891-8ee1-4f33-b569-d05adf5dcd95 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.845709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdd891-8ee1-4f33-b569-d05adf5dcd95 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.845977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdd891-8ee1-4f33-b569-d05adf5dcd95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.846678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdd891-8ee1-4f33-b569-d05adf5dcd95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.848085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bdd891-8ee1-4f33-b569-d05adf5dcd95 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:01.868969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46247fb-1c03-4753-966f-37be2e055a84 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:01.883218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:01.903450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8107c6d-98e1-441c-a7b1-58cdf4f24d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:01.904089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8107c6d-98e1-441c-a7b1-58cdf4f24d90 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:01.904391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8107c6d-98e1-441c-a7b1-58cdf4f24d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:01.904688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8107c6d-98e1-441c-a7b1-58cdf4f24d90 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:01.905974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8107c6d-98e1-441c-a7b1-58cdf4f24d90 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:01.907423 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8107c6d-98e1-441c-a7b1-58cdf4f24d90 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:02.003048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 524/1050] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:06:01 2022] POST /identity/v3/endpoints => generated 327 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:06:02.077806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 527/1051] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:06:01 2022] POST /identity/v3/users => generated 285 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:06:03.311822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794d3c-22bd-4809-9c62-7f378e20583b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:03.312343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794d3c-22bd-4809-9c62-7f378e20583b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:03.312343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf794d3c-22bd-4809-9c62-7f378e20583b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:03.313885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 525/1052] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:03.318910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57e8d-b031-42a5-ac54-fe462c0857be None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:03.319284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57e8d-b031-42a5-ac54-fe462c0857be None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:03.319476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f57e8d-b031-42a5-ac54-fe462c0857be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:03.337880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-62f57e8d-b031-42a5-ac54-fe462c0857be None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:03.339052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-62f57e8d-b031-42a5-ac54-fe462c0857be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:03.412539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 528/1053] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:03.434471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794d3c-22bd-4809-9c62-7f378e20583b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:03.446220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:03.535997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf794d3c-22bd-4809-9c62-7f378e20583b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:03.569533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:03.570201 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:03.570479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:03.570753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:03.582058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:03.586940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:03.588086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:03.589096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 526/1054] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 18:06:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:03.594276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f57e8d-b031-42a5-ac54-fe462c0857be None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:03.688725 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:03.694986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f57e8d-b031-42a5-ac54-fe462c0857be None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:03.728157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:03.728860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:03.729167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:03.729445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:03.730218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:03.730509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:03.731867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:03.744434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 529/1055] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 18:06:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:03.746392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:03.814543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:03.848571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622317b7-13eb-48de-8998-959b2c763719 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:03.882740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7d45c8-5f1a-4298-ba8f-bd5cf73ba5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:03.883379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d45c8-5f1a-4298-ba8f-bd5cf73ba5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:03.883656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d45c8-5f1a-4298-ba8f-bd5cf73ba5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:03.883926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7d45c8-5f1a-4298-ba8f-bd5cf73ba5b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:03.894443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d45c8-5f1a-4298-ba8f-bd5cf73ba5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:03.895876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7d45c8-5f1a-4298-ba8f-bd5cf73ba5b5 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-bd7d45c8-5f1a-4298-ba8f-bd5cf73ba5b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:06:03.910355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:03.911301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:03.916861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:06:03.916861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:06:03.916861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:03.916861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:03.916861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 527/1056] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:06:03.918598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.019009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac8d8f9-0f59-4d39-938f-e4cc6aeab15c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.050595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda276e-e35d-4445-af88-59febcd42eb9 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.050919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda276e-e35d-4445-af88-59febcd42eb9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.051155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfda276e-e35d-4445-af88-59febcd42eb9 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.052642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 528/1057] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:06:04.052745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.053324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.053665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.053970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.054658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:04.054959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.056410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.057520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c14e-3db8-4ad2-8887-e2c77113ee81 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.057914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c14e-3db8-4ad2-8887-e2c77113ee81 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.058188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc3c14e-3db8-4ad2-8887-e2c77113ee81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.074000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 530/1058] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:06:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:04.075488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.079649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5fc3c14e-3db8-4ad2-8887-e2c77113ee81 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:04.080966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5fc3c14e-3db8-4ad2-8887-e2c77113ee81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:04.102028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:04.159372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 529/1059] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:04.160715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171b2b-4d0e-4e45-a964-ba8506705b19 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.161004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171b2b-4d0e-4e45-a964-ba8506705b19 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.161276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4171b2b-4d0e-4e45-a964-ba8506705b19 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.162759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 530/1060] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:04.167847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9531df-41aa-4a85-8606-4ddb5ad20d8d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.168129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9531df-41aa-4a85-8606-4ddb5ad20d8d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.168412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9531df-41aa-4a85-8606-4ddb5ad20d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.185838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5d9531df-41aa-4a85-8606-4ddb5ad20d8d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:04.187577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5d9531df-41aa-4a85-8606-4ddb5ad20d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:04.192403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2285e0-0f56-45ad-a91e-c52cd4cdb77a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.225775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.226421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.226694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.226960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] PATH_INFO: `/v3/users/nova` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.234223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:04.234392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.235798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:06:04.247216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:04.248309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:04.249280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 531/1061] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:06:04.250010 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.259507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 531/1062] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:06:04.260583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9531df-41aa-4a85-8606-4ddb5ad20d8d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.329479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:04.350687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afa9d70-5011-43e6-9b93-a0c8a557c6cc None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.365267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9531df-41aa-4a85-8606-4ddb5ad20d8d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.384810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.385428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.385709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.386014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.460483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.461093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.461370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.461639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.462452 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:04.462754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.464178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.481741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 532/1063] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:04.482573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.494566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.496008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.520992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:04.569735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:04.578701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeb6654-a7ca-4c2f-9bc7-dfaa37740c4f None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.591227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 532/1064] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:04.591962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.612982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.613622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.613957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.614232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.624621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:04.629652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:04.635961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 533/1065] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:04.636961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.694526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5188ec-b312-47b3-9066-45598733b1de None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.727738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.728043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:04.728372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.728652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.728924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.731845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8533a5c7-300c-4947-92d0-cd71d44b8c66 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.739807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.741242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:06:04.755597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:04.756501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:04.757506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:06:04.757506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:06:04.757506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:04.757506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:04.757506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 533/1066] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:04.757821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.769184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.769855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.770134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.770406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.780606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.782061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.789863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:06:04.796826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:04.797929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:04.802519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:06:04.802519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:06:04.802519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:04.802519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:04.802519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 534/1067] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:04.802519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.860690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaed084-f265-44a3-9fc6-540bbd8cd0b2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.893635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.894282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.894557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.894826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.895523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:04.895817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.897178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.898705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f421e530-ba2a-4f98-9087-bd82960ebc71 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:04.905737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 534/1068] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:04.906528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.932017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:04.932626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:04.932905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:04.933186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:04.933899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:04.934209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:04.935567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:04.948522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 535/1069] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:04.949313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:04.963037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:05.004487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:05.013167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c69c6d-b3bd-47c8-93a5-65af7ad5ad45 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.046263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.046881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.047161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.047434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.048114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:05.048414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.049111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c8b0be-26b8-4d9e-aa9f-206b229b4728 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.049796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.062237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 535/1070] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:05.063023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:05.094224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.094941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.095246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.095524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] PATH_INFO: `/v3/users/79c69a2b73eb4dbc9c5a197f5602dceb` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.118274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] RBAC: Authorizing `identity:get_user(user_id=79c69a2b73eb4dbc9c5a197f5602dceb)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.119893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.121750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 536/1071] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:04 2022] GET /identity/v3/users/79c69a2b73eb4dbc9c5a197f5602dceb => generated 285 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:05.127994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:05.181189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f651050a-8f1c-4410-b923-3dbc058a4e39 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.202623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:05.222197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.223388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.223388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.223562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.231215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.233905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.240075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f6f10b-65b3-48cb-8868-9c1d81bd7ade None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:06:05.246497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:05.249676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:05.250630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 536/1072] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:06:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:05.253733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:05.273103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:05.282560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.283242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.283827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.284160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.361590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.363060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.370363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51ff073-1428-4228-940b-690f1579d6c9 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.403558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.404174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.404453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.405285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.406061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:05.406366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.407781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.419398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 537/1073] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:06:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:05.425295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:05.427286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:05.460731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 537/1074] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 27 18:06:05.466710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:05.493320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:05.522919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b187f3fd-fa9d-407e-9ddd-bbab13b5a875 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.557318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e1fbd-d228-4de1-83a9-82506cb2cd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.558011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1fbd-d228-4de1-83a9-82506cb2cd74 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.558351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1fbd-d228-4de1-83a9-82506cb2cd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.558633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e1fbd-d228-4de1-83a9-82506cb2cd74 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/4e107a27b86243dcbb160a3960682b2d/roles/fceb6b99a80a415db7c7296d02138e0e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.560940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e1fbd-d228-4de1-83a9-82506cb2cd74 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=4e107a27b86243dcbb160a3960682b2d, role_id=fceb6b99a80a415db7c7296d02138e0e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.562468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82e1fbd-d228-4de1-83a9-82506cb2cd74 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.564618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f56669-c89c-4738-a280-e43b7d2b7886 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.598347 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.598974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.599253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.599522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.600660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d69c52b7194cad9b71d7de0a41fcef)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.602104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.603778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 538/1075] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:05 2022] GET /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:05.609889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:05.642644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 538/1076] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:06:05 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/4e107a27b86243dcbb160a3960682b2d/roles/fceb6b99a80a415db7c7296d02138e0e => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:06:05.643850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:05.713545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fcbbb0-c944-4b6c-8b53-84ddaa040002 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:05.750239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74a6104-804b-4c5c-af35-b77341d4126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:05.750874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6104-804b-4c5c-af35-b77341d4126c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:05.751152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6104-804b-4c5c-af35-b77341d4126c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:05.751421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74a6104-804b-4c5c-af35-b77341d4126c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:05.752222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a6104-804b-4c5c-af35-b77341d4126c None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef, user.id=79c69a2b73eb4dbc9c5a197f5602dceb) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:05.752531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a6104-804b-4c5c-af35-b77341d4126c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:05.753997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74a6104-804b-4c5c-af35-b77341d4126c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:05.773792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 539/1077] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:05 2022] GET /identity/v3/role_assignments?user.id=79c69a2b73eb4dbc9c5a197f5602dceb&scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:07.638338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c3601-9007-4e69-87ec-168bd3f89b6b None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:07.639410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c3601-9007-4e69-87ec-168bd3f89b6b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:07.639410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c3601-9007-4e69-87ec-168bd3f89b6b None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:07.640806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 539/1078] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:07.646336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1aa18-8ff8-4bf3-8c62-5b1f87a491aa None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:07.646772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1aa18-8ff8-4bf3-8c62-5b1f87a491aa None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:07.646891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1aa18-8ff8-4bf3-8c62-5b1f87a491aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:07.665288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-13f1aa18-8ff8-4bf3-8c62-5b1f87a491aa None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:07.666485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-13f1aa18-8ff8-4bf3-8c62-5b1f87a491aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:07.715306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc55eb4-fdad-412b-a4b9-c08d8008dffc None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:07.715597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc55eb4-fdad-412b-a4b9-c08d8008dffc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:07.715863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc55eb4-fdad-412b-a4b9-c08d8008dffc None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:07.717800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 540/1079] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:06:07.722602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7710-1af8-4376-a64a-f8312762e95b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:07.722886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7710-1af8-4376-a64a-f8312762e95b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:07.723163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caed7710-1af8-4376-a64a-f8312762e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:07.731529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 540/1080] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:07.740376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-caed7710-1af8-4376-a64a-f8312762e95b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:07.741545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-caed7710-1af8-4376-a64a-f8312762e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:07.754301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1aa18-8ff8-4bf3-8c62-5b1f87a491aa None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:07.784033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:07.806709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 541/1081] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:06:07.829052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7710-1af8-4376-a64a-f8312762e95b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:07.853158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f1aa18-8ff8-4bf3-8c62-5b1f87a491aa None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:07.889711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:07.900202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:07.900874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:07.901158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:07.907479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:07.912267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:07.917153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:07.918216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:07.919046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 541/1082] 10.222.0.67 () {56 vars in 1120 bytes} [Wed Jul 27 18:06:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:06:07.924813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:07.934107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caed7710-1af8-4376-a64a-f8312762e95b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:07.967666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:07.968302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:07.968578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:07.968849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:07.979010 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:07.986491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:07.987627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:07.988638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 542/1083] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:06:07.993434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.017975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.027306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d17cf1-a76c-493f-b9a1-522962c12767 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.062595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.063210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.063491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.063765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.064474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:08.064777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.066208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.074280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 542/1084] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 18:06:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:08.079778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.092775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac847-bcdd-4e07-bd4d-d78a89dd6e76 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.115031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.127639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.128258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.128534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.128801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.129500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:08.129826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.131185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.139689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 543/1085] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:08.145418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.184071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eae65b-2c41-4e24-aeaf-f4056f89fdec None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.217956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.218586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.218864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.219496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.230306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.231741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.243525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ae44ae-9977-44cb-ad08-5056d4413b23 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:06:08.247026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:08.248058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:08.249061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:06:08.249061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:06:08.249061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:08.249061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:08.249061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 543/1086] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:06:08.254044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.258239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.276516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.277408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.277681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.277983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] PATH_INFO: `/v3/users/79c69a2b73eb4dbc9c5a197f5602dceb` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.279138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] RBAC: Authorizing `identity:get_user(user_id=79c69a2b73eb4dbc9c5a197f5602dceb)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.281202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.282827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 544/1087] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:08 2022] GET /identity/v3/users/79c69a2b73eb4dbc9c5a197f5602dceb => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:08.288445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.338981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.355011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5980f9-d770-4f86-8e9c-831245da2986 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.384566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c50966-4aeb-470f-9175-6b4fe875c22f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.388006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.388611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.389402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.389666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.390366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:08.390662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.392003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.403742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 544/1088] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:06:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:08.410390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.419789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.420465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.420743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.421022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.422227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d69c52b7194cad9b71d7de0a41fcef)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.423655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.425322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 545/1089] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:08 2022] GET /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:08.431172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.472015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.508240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd594fba-5cf4-4513-bd93-11f5358d49ae None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.527779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cdc09-5368-4407-885d-a8a1461bbd81 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.543087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.543721 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.544000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.544275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.547306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.551342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.552783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.562948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.563614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.563906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.564184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef/users/79c69a2b73eb4dbc9c5a197f5602dceb/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:06:08.564303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:08.565416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:08.566641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 545/1090] 10.222.0.67 () {56 vars in 1093 bytes} [Wed Jul 27 18:06:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:08.568683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] RBAC: Authorizing `identity:create_grant(project_id=c3d69c52b7194cad9b71d7de0a41fcef, user_id=79c69a2b73eb4dbc9c5a197f5602dceb, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.570311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.571050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.664830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 546/1091] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:06:08 2022] PUT /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef/users/79c69a2b73eb4dbc9c5a197f5602dceb/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:06:08.669077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0215b6-42b9-4b9e-a814-a09d92c12988 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.694946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.706854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.707486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.707788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.708051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.708860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:08.709169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.710666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:08.729996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 546/1092] 10.222.0.67 () {56 vars in 1133 bytes} [Wed Jul 27 18:06:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:06:08.736066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:08.841452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab58c24-6a13-4495-b3fa-e7f3069ff27a None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:08.874395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:08.875013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:08.875297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:08.875573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:08.923121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:08.941990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:08.943448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:09.045696 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 547/1093] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:09.046892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:09.147983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad250273-4fdc-485e-b1a7-67e8348d96dd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:09.181523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:09.182121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:09.182404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:09.182680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:09.193157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:09.194620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:06:09.209027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:09.209995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:09.211264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:06:09.211264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:06:09.211264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:06:09.211264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:09.211264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 547/1094] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:09.215923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:09.293194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:09.312462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cf56aa-6bcf-4cb2-84ef-56c1ac49285d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:09.345460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:09.346107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:09.346379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:09.346643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:09.347316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:09.347612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:09.348960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:09.360446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 548/1095] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:06:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:09.366116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:09.400276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:09.463948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c69e34-74c4-4e9c-8829-22d0285caedd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:09.498083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:09.498716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:09.498995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:09.499267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:09.505703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:09.507165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:06:09.518144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:09.519014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:09.520039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 548/1096] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:06:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:06:09.525114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:09.622617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf141bc-c434-49b2-9e3b-419b0984571b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:09.655621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa5d3f-0ea1-4a60-aac0-6c8225bb9b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:09.656223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5d3f-0ea1-4a60-aac0-6c8225bb9b74 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:09.656499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5d3f-0ea1-4a60-aac0-6c8225bb9b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:09.656765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa5d3f-0ea1-4a60-aac0-6c8225bb9b74 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:09.657488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa5d3f-0ea1-4a60-aac0-6c8225bb9b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:09.657829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa5d3f-0ea1-4a60-aac0-6c8225bb9b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:09.659245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa5d3f-0ea1-4a60-aac0-6c8225bb9b74 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:09.667970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:09.672886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 549/1097] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:06:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:09.679134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:09.773161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:09.780526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c425f-6e77-40dc-8b2f-b9e1fe228136 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:09.814470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7ed829-3715-4f90-b61a-5b9018ff8358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:09.815085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ed829-3715-4f90-b61a-5b9018ff8358 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:09.815365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ed829-3715-4f90-b61a-5b9018ff8358 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:09.815637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7ed829-3715-4f90-b61a-5b9018ff8358 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:09.816415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ed829-3715-4f90-b61a-5b9018ff8358 None admin] RBAC: Adding query filter params (role.id=fceb6b99a80a415db7c7296d02138e0e, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=4e107a27b86243dcbb160a3960682b2d) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:09.816722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ed829-3715-4f90-b61a-5b9018ff8358 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:09.818244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7ed829-3715-4f90-b61a-5b9018ff8358 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:09.823981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 549/1098] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:09 2022] GET /identity/v3/role_assignments?user.id=4e107a27b86243dcbb160a3960682b2d&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fceb6b99a80a415db7c7296d02138e0e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:10.637320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239786-9155-4c18-9700-9e69a885da75 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:10.637605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239786-9155-4c18-9700-9e69a885da75 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:10.637922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b239786-9155-4c18-9700-9e69a885da75 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:10.639300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 550/1099] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:10.644828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345974-aa49-4560-84a1-d8bcc40e512b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:10.645109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345974-aa49-4560-84a1-d8bcc40e512b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:10.645378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85345974-aa49-4560-84a1-d8bcc40e512b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:10.663452 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-85345974-aa49-4560-84a1-d8bcc40e512b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:10.664621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-85345974-aa49-4560-84a1-d8bcc40e512b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:10.728865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 550/1100] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:10.752684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239786-9155-4c18-9700-9e69a885da75 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:10.852474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b239786-9155-4c18-9700-9e69a885da75 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:10.886005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:10.886639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:10.886919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:10.887192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:10.897091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:10.902183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:10.903275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:10.904786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 551/1101] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:10.910047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345974-aa49-4560-84a1-d8bcc40e512b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:10.992451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:11.004372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85345974-aa49-4560-84a1-d8bcc40e512b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:11.037750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:11.038371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:11.038646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:11.038914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:11.039611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:11.039907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:11.041249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:11.049546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 551/1102] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:11.055259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:11.113519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:11.152051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebf92cc-1a28-4b4c-b887-d6890b9890d0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:11.185361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:11.186014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:11.186294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:11.186562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] PATH_INFO: `/v3/users/79c69a2b73eb4dbc9c5a197f5602dceb` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:11.187711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] RBAC: Authorizing `identity:get_user(user_id=79c69a2b73eb4dbc9c5a197f5602dceb)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:11.189140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:11.190772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 552/1103] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:11 2022] GET /identity/v3/users/79c69a2b73eb4dbc9c5a197f5602dceb => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:11.196526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:11.293110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901cf97-5ee2-4398-95c8-9a8938ebdd17 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:11.325593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:11.326731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:11.327010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:11.327281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:11.345422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:11.392596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:11.394060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:11.503132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 552/1104] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:11.503744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:11.603906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6b705-2be4-4a56-a42f-aea99a4c6032 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:11.628520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:11.636170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f311bab1-4497-4118-b13b-ccd76672bd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:11.636803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311bab1-4497-4118-b13b-ccd76672bd17 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:11.639225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311bab1-4497-4118-b13b-ccd76672bd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:11.639225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f311bab1-4497-4118-b13b-ccd76672bd17 None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:11.639225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311bab1-4497-4118-b13b-ccd76672bd17 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d69c52b7194cad9b71d7de0a41fcef)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:11.640532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f311bab1-4497-4118-b13b-ccd76672bd17 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:11.642245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 553/1105] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:11 2022] GET /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:11.648467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:11.696501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:11.746332 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200c4a8-77f4-45b9-b912-f69478076017 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:11.779687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd6800c-3959-4057-b72c-ec131d44c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:11.780232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6800c-3959-4057-b72c-ec131d44c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:11.780506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6800c-3959-4057-b72c-ec131d44c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:11.780772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd6800c-3959-4057-b72c-ec131d44c0a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:11.781540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6800c-3959-4057-b72c-ec131d44c0a9 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef, user.id=79c69a2b73eb4dbc9c5a197f5602dceb) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:11.781889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6800c-3959-4057-b72c-ec131d44c0a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:11.783263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd6800c-3959-4057-b72c-ec131d44c0a9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:11.788801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 553/1106] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:11 2022] GET /identity/v3/role_assignments?user.id=79c69a2b73eb4dbc9c5a197f5602dceb&scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:13.789560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3802d1-223a-4bb2-ab93-9cfa1d967589 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:13.790160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3802d1-223a-4bb2-ab93-9cfa1d967589 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:13.790160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3802d1-223a-4bb2-ab93-9cfa1d967589 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:13.791476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 554/1107] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:13.796508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7c9e-c053-4075-a988-aaddb75795d4 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:13.796926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7c9e-c053-4075-a988-aaddb75795d4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:13.797056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaa7c9e-c053-4075-a988-aaddb75795d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:13.814704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9eaa7c9e-c053-4075-a988-aaddb75795d4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:13.815871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9eaa7c9e-c053-4075-a988-aaddb75795d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:13.879521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 554/1108] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:13.903526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3802d1-223a-4bb2-ab93-9cfa1d967589 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:14.001285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3802d1-223a-4bb2-ab93-9cfa1d967589 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:14.038183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99af0f8-2602-4f75-b84d-41f4b4503d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:14.039369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af0f8-2602-4f75-b84d-41f4b4503d0f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:14.039369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af0f8-2602-4f75-b84d-41f4b4503d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:14.039369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99af0f8-2602-4f75-b84d-41f4b4503d0f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:14.040533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99af0f8-2602-4f75-b84d-41f4b4503d0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:14.042057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99af0f8-2602-4f75-b84d-41f4b4503d0f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:14.043766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 555/1109] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:14.050059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa7c9e-c053-4075-a988-aaddb75795d4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:14.094969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:14.146755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaa7c9e-c053-4075-a988-aaddb75795d4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:14.178847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9081021e-97db-4050-b4f8-326b4cb7405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:14.179456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081021e-97db-4050-b4f8-326b4cb7405c None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:14.179736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081021e-97db-4050-b4f8-326b4cb7405c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:14.180009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081021e-97db-4050-b4f8-326b4cb7405c None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:14.180677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081021e-97db-4050-b4f8-326b4cb7405c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:14.182131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9081021e-97db-4050-b4f8-326b4cb7405c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:14.258110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 555/1110] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:06:14 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:06:16.255503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286392f8-e8bd-4692-90c3-55cbd0214270 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:16.256050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286392f8-e8bd-4692-90c3-55cbd0214270 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:16.256050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286392f8-e8bd-4692-90c3-55cbd0214270 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:16.257585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 556/1111] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:16.262927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a5b57-3ae0-4bf6-8a1f-6831f5362ca6 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:16.263342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a5b57-3ae0-4bf6-8a1f-6831f5362ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:16.263486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a5b57-3ae0-4bf6-8a1f-6831f5362ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:16.282484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-945a5b57-3ae0-4bf6-8a1f-6831f5362ca6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:16.283700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-945a5b57-3ae0-4bf6-8a1f-6831f5362ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:16.355955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 556/1112] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:16.379786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286392f8-e8bd-4692-90c3-55cbd0214270 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:16.443881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:16.481683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286392f8-e8bd-4692-90c3-55cbd0214270 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:16.515135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:16.515775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:16.516050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:16.516342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] PATH_INFO: `/v3/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:16.517739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] RBAC: Authorizing `identity:get_role(role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:16.519117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:16.520466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 557/1113] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:16 2022] GET /identity/v3/roles/2553b3a661e245038eb65b3da25540d8 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:16.526592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a5b57-3ae0-4bf6-8a1f-6831f5362ca6 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:16.560612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:16.632232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a5b57-3ae0-4bf6-8a1f-6831f5362ca6 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:16.665909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:16.666545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:16.666826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:16.667096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] PATH_INFO: `/v3/users/7114791cad3445fbb2e318b69f5b8bb0` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:16.680229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] RBAC: Authorizing `identity:get_user(user_id=7114791cad3445fbb2e318b69f5b8bb0)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:16.681658 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:16.683299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 557/1114] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:16 2022] GET /identity/v3/users/7114791cad3445fbb2e318b69f5b8bb0 => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:16.689114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:16.787588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1e53be-e459-4205-bfba-b5034fe15319 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:16.814544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:16.819194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:16.819800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:16.820075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:16.820344 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:16.884602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:16.885995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:16.979347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 558/1115] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:16.985856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:17.069785 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:17.081107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b7df89-2941-48d6-a376-2f729fcfa021 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:17.115085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc68e7-d357-44e1-9233-637a38b12f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:17.115723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc68e7-d357-44e1-9233-637a38b12f97 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:17.116000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc68e7-d357-44e1-9233-637a38b12f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:17.116273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc68e7-d357-44e1-9233-637a38b12f97 None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:17.117412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc68e7-d357-44e1-9233-637a38b12f97 None admin] RBAC: Authorizing `identity:get_project(project_id=c3d69c52b7194cad9b71d7de0a41fcef)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:17.118874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddc68e7-d357-44e1-9233-637a38b12f97 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:17.120538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 558/1116] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:16 2022] GET /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:17.126616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:17.156460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:17.222451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dca68a-7f8c-413e-930a-c36afa46e44e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:17.254819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf6e58-ceb1-4c38-8f35-03b4630c4868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:17.255422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6e58-ceb1-4c38-8f35-03b4630c4868 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:17.255703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6e58-ceb1-4c38-8f35-03b4630c4868 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:17.256221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6e58-ceb1-4c38-8f35-03b4630c4868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:17.256737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf6e58-ceb1-4c38-8f35-03b4630c4868 None admin] RBAC: Adding query filter params (role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef, user.id=7114791cad3445fbb2e318b69f5b8bb0) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:17.257045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf6e58-ceb1-4c38-8f35-03b4630c4868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:17.258508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf6e58-ceb1-4c38-8f35-03b4630c4868 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:17.263740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 559/1117] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:17 2022] GET /identity/v3/role_assignments?user.id=7114791cad3445fbb2e318b69f5b8bb0&scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef&role.id=2553b3a661e245038eb65b3da25540d8 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:19.226628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a67d8-879d-4af8-96e1-873e1a5a89c3 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:19.227162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a67d8-879d-4af8-96e1-873e1a5a89c3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:19.227162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a67d8-879d-4af8-96e1-873e1a5a89c3 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:19.228533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 559/1118] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:19.233607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990438-295e-4072-9c27-11aa3231956e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:19.234031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990438-295e-4072-9c27-11aa3231956e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:19.234191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04990438-295e-4072-9c27-11aa3231956e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:19.252286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-04990438-295e-4072-9c27-11aa3231956e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:19.253460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-04990438-295e-4072-9c27-11aa3231956e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:19.317583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 560/1119] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:19.339830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a67d8-879d-4af8-96e1-873e1a5a89c3 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:19.438359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a67d8-879d-4af8-96e1-873e1a5a89c3 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:19.470887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:19.471507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:19.471786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:19.472055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] PATH_INFO: `/v3/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:19.473479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] RBAC: Authorizing `identity:get_role(role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:19.475033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:19.476360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 560/1120] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:19 2022] GET /identity/v3/roles/2553b3a661e245038eb65b3da25540d8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:19.482063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990438-295e-4072-9c27-11aa3231956e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:19.508219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:19.579429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04990438-295e-4072-9c27-11aa3231956e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:19.611921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:19.612543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:19.612820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:19.613092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] PATH_INFO: `/v3/users/7114791cad3445fbb2e318b69f5b8bb0` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:19.614256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] RBAC: Authorizing `identity:get_user(user_id=7114791cad3445fbb2e318b69f5b8bb0)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:19.615674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:19.617262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 561/1121] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:19 2022] GET /identity/v3/users/7114791cad3445fbb2e318b69f5b8bb0 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:19.623590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:19.647744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:19.719221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc17fe4-bcec-460d-ad63-3aeb4a50e004 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:19.752295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fd19b-cb5c-4161-9db2-52631ae67bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:19.752913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fd19b-cb5c-4161-9db2-52631ae67bdb None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:19.753191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fd19b-cb5c-4161-9db2-52631ae67bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:19.753465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fd19b-cb5c-4161-9db2-52631ae67bdb None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:19.754641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fd19b-cb5c-4161-9db2-52631ae67bdb None admin] RBAC: Authorizing `identity:get_project(project_id=c3d69c52b7194cad9b71d7de0a41fcef)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:19.756044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fd19b-cb5c-4161-9db2-52631ae67bdb None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:19.757686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 561/1122] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:19 2022] GET /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:19.763588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:19.854202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:19.861030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8e8b1-f8dd-4fee-82fe-98431771dddb None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:19.894297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8833952-0120-46d9-a08a-89e984c3d86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:19.894960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833952-0120-46d9-a08a-89e984c3d86f None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:19.895243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833952-0120-46d9-a08a-89e984c3d86f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:19.895518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8833952-0120-46d9-a08a-89e984c3d86f None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef/users/7114791cad3445fbb2e318b69f5b8bb0/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:19.897674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8833952-0120-46d9-a08a-89e984c3d86f None admin] RBAC: Authorizing `identity:create_grant(project_id=c3d69c52b7194cad9b71d7de0a41fcef, user_id=7114791cad3445fbb2e318b69f5b8bb0, role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:19.899124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8833952-0120-46d9-a08a-89e984c3d86f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:19.989116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 562/1123] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:06:19 2022] PUT /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef/users/7114791cad3445fbb2e318b69f5b8bb0/roles/2553b3a661e245038eb65b3da25540d8 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:06:21.953491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffcd07-98c2-49f3-a9a2-910dd95e77cf None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:21.954074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffcd07-98c2-49f3-a9a2-910dd95e77cf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:21.954074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffcd07-98c2-49f3-a9a2-910dd95e77cf None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:21.955439 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 562/1124] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:21.960613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb24db-60b3-4a2c-9da2-c4fda26b520e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:21.961027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb24db-60b3-4a2c-9da2-c4fda26b520e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:21.961158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb24db-60b3-4a2c-9da2-c4fda26b520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:21.978555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6ecb24db-60b3-4a2c-9da2-c4fda26b520e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:21.979714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6ecb24db-60b3-4a2c-9da2-c4fda26b520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:22.045922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 563/1125] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:22.068668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffcd07-98c2-49f3-a9a2-910dd95e77cf None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:22.159541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:22.168839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffcd07-98c2-49f3-a9a2-910dd95e77cf None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:22.202413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:22.203041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:22.203322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:22.203642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] PATH_INFO: `/v3/roles/2553b3a661e245038eb65b3da25540d8` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:22.205052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] RBAC: Authorizing `identity:get_role(role_id=2553b3a661e245038eb65b3da25540d8)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:22.206433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:22.207791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 563/1126] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:22 2022] GET /identity/v3/roles/2553b3a661e245038eb65b3da25540d8 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:22.213575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb24db-60b3-4a2c-9da2-c4fda26b520e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:22.292344 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:22.307583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb24db-60b3-4a2c-9da2-c4fda26b520e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:22.339751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:22.340373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:22.340646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:22.340915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] PATH_INFO: `/v3/users/7114791cad3445fbb2e318b69f5b8bb0` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:22.342606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] RBAC: Authorizing `identity:get_user(user_id=7114791cad3445fbb2e318b69f5b8bb0)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:22.344375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:22.346263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 564/1127] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:22 2022] GET /identity/v3/users/7114791cad3445fbb2e318b69f5b8bb0 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:22.351741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:22.448991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e170ad-8047-4da9-833c-879292ac5bc7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:22.482383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:22.482986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:22.483266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:22.483540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:22.509750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:22.549297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:22.550763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:22.645858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 564/1128] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:22 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:22.651965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:22.746296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba57a10-e70a-48c1-b2d3-b35f8aabc928 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:22.778794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddd5b22-719e-4cc8-b796-039d9c0df56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:22.779412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd5b22-719e-4cc8-b796-039d9c0df56f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:22.779691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd5b22-719e-4cc8-b796-039d9c0df56f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:22.779960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddd5b22-719e-4cc8-b796-039d9c0df56f None admin] PATH_INFO: `/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:22.781126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd5b22-719e-4cc8-b796-039d9c0df56f None admin] RBAC: Authorizing `identity:get_project(project_id=c3d69c52b7194cad9b71d7de0a41fcef)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:22.782565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddd5b22-719e-4cc8-b796-039d9c0df56f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:22.784192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 565/1129] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:22 2022] GET /identity/v3/projects/c3d69c52b7194cad9b71d7de0a41fcef => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:22.790062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:22.847132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:22.887018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abeb11a-4847-4b83-b064-8f2a62360e69 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:22.924775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f6495b-bfc1-4a39-a697-f5302b5571ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:22.925380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6495b-bfc1-4a39-a697-f5302b5571ca None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:22.925659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6495b-bfc1-4a39-a697-f5302b5571ca None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:22.925961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f6495b-bfc1-4a39-a697-f5302b5571ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:22.926743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6495b-bfc1-4a39-a697-f5302b5571ca None admin] RBAC: Adding query filter params (role.id=2553b3a661e245038eb65b3da25540d8, scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef, user.id=7114791cad3445fbb2e318b69f5b8bb0) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:22.927050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6495b-bfc1-4a39-a697-f5302b5571ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:22.928462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f6495b-bfc1-4a39-a697-f5302b5571ca None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:22.934182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 565/1130] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:22 2022] GET /identity/v3/role_assignments?user.id=7114791cad3445fbb2e318b69f5b8bb0&scope.project.id=c3d69c52b7194cad9b71d7de0a41fcef&role.id=2553b3a661e245038eb65b3da25540d8 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:24.920232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4dd9-0715-4d1d-82e2-b990a4d8a0df None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:24.920781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4dd9-0715-4d1d-82e2-b990a4d8a0df None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:24.920781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e4dd9-0715-4d1d-82e2-b990a4d8a0df None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:24.922972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 566/1131] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:24.928566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43622-990f-4daa-ad25-cc7d68d9338b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:24.928966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43622-990f-4daa-ad25-cc7d68d9338b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:24.929117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f43622-990f-4daa-ad25-cc7d68d9338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:24.947388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-43f43622-990f-4daa-ad25-cc7d68d9338b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:24.948584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-43f43622-990f-4daa-ad25-cc7d68d9338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:25.014095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 566/1132] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:25.037487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4dd9-0715-4d1d-82e2-b990a4d8a0df None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:25.059140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:25.135635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e4dd9-0715-4d1d-82e2-b990a4d8a0df None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:25.171138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53369b7-f9fb-4395-bda1-6ec591458dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:25.171709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53369b7-f9fb-4395-bda1-6ec591458dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:25.171990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53369b7-f9fb-4395-bda1-6ec591458dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:25.172264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53369b7-f9fb-4395-bda1-6ec591458dc7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:25.173400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53369b7-f9fb-4395-bda1-6ec591458dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:25.174859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53369b7-f9fb-4395-bda1-6ec591458dc7 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:25.176457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 567/1133] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:25.182364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43622-990f-4daa-ad25-cc7d68d9338b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:25.235711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:25.277537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f43622-990f-4daa-ad25-cc7d68d9338b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:25.311366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd7678-711e-4dc4-8f63-2e02ec87febd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:25.311969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7678-711e-4dc4-8f63-2e02ec87febd None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:25.312242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7678-711e-4dc4-8f63-2e02ec87febd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:25.312512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd7678-711e-4dc4-8f63-2e02ec87febd None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:25.313175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd7678-711e-4dc4-8f63-2e02ec87febd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:25.314620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd7678-711e-4dc4-8f63-2e02ec87febd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:25.425116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 567/1134] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:06:25 2022] POST /identity/v3/projects => generated 311 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:06:27.457145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484d57f-e07d-4e33-b8b0-845e860b5d42 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:27.457664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484d57f-e07d-4e33-b8b0-845e860b5d42 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:27.457664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8484d57f-e07d-4e33-b8b0-845e860b5d42 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:27.458976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 568/1135] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:27.464151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34a669-1be8-4339-949e-cf210ecffd85 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:27.464518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34a669-1be8-4339-949e-cf210ecffd85 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:27.464697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c34a669-1be8-4339-949e-cf210ecffd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:27.482368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9c34a669-1be8-4339-949e-cf210ecffd85 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:27.483542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9c34a669-1be8-4339-949e-cf210ecffd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:27.548208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 568/1136] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:27.572397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484d57f-e07d-4e33-b8b0-845e860b5d42 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:27.657896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:27.670745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8484d57f-e07d-4e33-b8b0-845e860b5d42 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:27.705526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f9e17a-78fa-40ed-94fb-31fe478819d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:27.706262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9e17a-78fa-40ed-94fb-31fe478819d9 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:27.706540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9e17a-78fa-40ed-94fb-31fe478819d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:27.706806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f9e17a-78fa-40ed-94fb-31fe478819d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:27.707994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9e17a-78fa-40ed-94fb-31fe478819d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:27.709660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f9e17a-78fa-40ed-94fb-31fe478819d9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:27.711528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 569/1137] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:06:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:27.717390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34a669-1be8-4339-949e-cf210ecffd85 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:27.750493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:27.814028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c34a669-1be8-4339-949e-cf210ecffd85 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:27.846182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd062c4-c6f2-46d7-aad2-88b587af9d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:27.846790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd062c4-c6f2-46d7-aad2-88b587af9d96 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:27.847071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd062c4-c6f2-46d7-aad2-88b587af9d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:27.847344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd062c4-c6f2-46d7-aad2-88b587af9d96 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:27.848021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd062c4-c6f2-46d7-aad2-88b587af9d96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:27.849440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd062c4-c6f2-46d7-aad2-88b587af9d96 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:27.925921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 569/1138] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:06:27 2022] POST /identity/v3/users => generated 286 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:06:29.949265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0da04-0631-45bc-87bf-dc9e4913f6db None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:29.949843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0da04-0631-45bc-87bf-dc9e4913f6db None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:29.949843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb0da04-0631-45bc-87bf-dc9e4913f6db None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:29.951769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 570/1139] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:29.956993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be39936-20b4-4b68-a0a1-4be2eefbfbca None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:29.957412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be39936-20b4-4b68-a0a1-4be2eefbfbca None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:29.957548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be39936-20b4-4b68-a0a1-4be2eefbfbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:29.975917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4be39936-20b4-4b68-a0a1-4be2eefbfbca None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:29.977096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4be39936-20b4-4b68-a0a1-4be2eefbfbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:30.042773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 570/1140] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:30.067264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0da04-0631-45bc-87bf-dc9e4913f6db None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:30.166704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb0da04-0631-45bc-87bf-dc9e4913f6db None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:30.200891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:30.201460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:30.201734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:30.202034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:30.211833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:30.216665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:30.217892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:30.218874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 571/1141] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:30.223826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be39936-20b4-4b68-a0a1-4be2eefbfbca None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:30.247446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:30.318664 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be39936-20b4-4b68-a0a1-4be2eefbfbca None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:30.350241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:30.350841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:30.351116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:30.351384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:30.352075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:30.352372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:30.353784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:30.362921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 571/1142] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:30.368605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:30.387413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:30.466717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452034ae-bb13-4eed-974a-ff60b27fa690 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:30.499198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:30.499821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:30.500101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:30.500374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] PATH_INFO: `/v3/users/43cd4af029a14c30ba19c83958f67f72` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:30.514280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] RBAC: Authorizing `identity:get_user(user_id=43cd4af029a14c30ba19c83958f67f72)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:30.515714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:30.517306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 572/1143] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:30 2022] GET /identity/v3/users/43cd4af029a14c30ba19c83958f67f72 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:30.522932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:30.603167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:30.617786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28caf95-d191-4d1c-a146-ec70fcbf11ca None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:30.650941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:30.651532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:30.651808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:30.652077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:30.715524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:30.716991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:30.794138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:30.809893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 572/1144] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:30.815856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:30.889139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:30.913180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d65aa3-3e33-4c0a-af21-fedf6c339a2d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:30.945567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb132b4e-b721-4cae-803e-dd7b3e68f9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:30.946245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132b4e-b721-4cae-803e-dd7b3e68f9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:30.946526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132b4e-b721-4cae-803e-dd7b3e68f9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:30.946800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb132b4e-b721-4cae-803e-dd7b3e68f9f8 None admin] PATH_INFO: `/v3/projects/0e25337b679d4d05918890a467b40d8f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:30.947946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb132b4e-b721-4cae-803e-dd7b3e68f9f8 None admin] RBAC: Authorizing `identity:get_project(project_id=0e25337b679d4d05918890a467b40d8f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:30.949402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb132b4e-b721-4cae-803e-dd7b3e68f9f8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:30.951666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 573/1145] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:30 2022] GET /identity/v3/projects/0e25337b679d4d05918890a467b40d8f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:30.957597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:31.052938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6bf549-2757-4c9e-953a-4b752eeb8698 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:31.086011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49318e23-8719-40bd-955c-e2adb7639506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:31.086616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318e23-8719-40bd-955c-e2adb7639506 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:31.086891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318e23-8719-40bd-955c-e2adb7639506 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:31.087158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49318e23-8719-40bd-955c-e2adb7639506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:31.087958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49318e23-8719-40bd-955c-e2adb7639506 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0e25337b679d4d05918890a467b40d8f, user.id=43cd4af029a14c30ba19c83958f67f72) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:31.088266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49318e23-8719-40bd-955c-e2adb7639506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:31.089670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49318e23-8719-40bd-955c-e2adb7639506 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:31.094982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 573/1146] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:30 2022] GET /identity/v3/role_assignments?user.id=43cd4af029a14c30ba19c83958f67f72&scope.project.id=0e25337b679d4d05918890a467b40d8f&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:33.088268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ca71e-8c23-41bf-b0f4-7cf3bdffa4c2 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:33.088824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ca71e-8c23-41bf-b0f4-7cf3bdffa4c2 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:33.088824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1ca71e-8c23-41bf-b0f4-7cf3bdffa4c2 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:33.090235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 574/1147] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:33.095325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a063-8efa-4f2b-bb2d-970783998b4f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:33.095735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a063-8efa-4f2b-bb2d-970783998b4f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:33.095877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3a063-8efa-4f2b-bb2d-970783998b4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:33.114324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0db3a063-8efa-4f2b-bb2d-970783998b4f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:33.115519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0db3a063-8efa-4f2b-bb2d-970783998b4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:33.158941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:33.181536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 574/1148] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:33.204295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ca71e-8c23-41bf-b0f4-7cf3bdffa4c2 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:33.302129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1ca71e-8c23-41bf-b0f4-7cf3bdffa4c2 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:33.334935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:33.335565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:33.335844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:33.336116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:33.346192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:33.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:33.352082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:33.352936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 575/1149] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:33.358807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3a063-8efa-4f2b-bb2d-970783998b4f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:33.455047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3a063-8efa-4f2b-bb2d-970783998b4f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:33.487913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:33.488510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:33.488784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:33.489050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:33.489745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:33.490072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:33.491411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:33.499240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 575/1150] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:33.504941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:33.508315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:33.603265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1f938-16ab-490f-89c8-35392c2670a6 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:33.640413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:33.641042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:33.641324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:33.641595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] PATH_INFO: `/v3/users/43cd4af029a14c30ba19c83958f67f72` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:33.642779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] RBAC: Authorizing `identity:get_user(user_id=43cd4af029a14c30ba19c83958f67f72)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:33.644203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:33.645827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 576/1151] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:33 2022] GET /identity/v3/users/43cd4af029a14c30ba19c83958f67f72 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:33.651786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:33.694438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:33.753140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed96b17-daa5-4e70-a623-70380b9d1352 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:33.785815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e50ba9c-e8a4-4268-bf34-16abe112b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:33.786444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ba9c-e8a4-4268-bf34-16abe112b2ac None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:33.786720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ba9c-e8a4-4268-bf34-16abe112b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:33.786990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e50ba9c-e8a4-4268-bf34-16abe112b2ac None admin] PATH_INFO: `/v3/projects/0e25337b679d4d05918890a467b40d8f` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:33.788112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50ba9c-e8a4-4268-bf34-16abe112b2ac None admin] RBAC: Authorizing `identity:get_project(project_id=0e25337b679d4d05918890a467b40d8f)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:33.789523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e50ba9c-e8a4-4268-bf34-16abe112b2ac None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:33.791208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 576/1152] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:33 2022] GET /identity/v3/projects/0e25337b679d4d05918890a467b40d8f => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:33.797268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:33.864268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:33.894272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8873407-a01b-4400-9f65-6fe5b1fb39d9 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:33.926337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461e20e-4eeb-43e3-b1e3-1473bad779e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:33.926982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e20e-4eeb-43e3-b1e3-1473bad779e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:33.927261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e20e-4eeb-43e3-b1e3-1473bad779e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:33.927533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461e20e-4eeb-43e3-b1e3-1473bad779e4 None admin] PATH_INFO: `/v3/projects/0e25337b679d4d05918890a467b40d8f/users/43cd4af029a14c30ba19c83958f67f72/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:33.929427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e20e-4eeb-43e3-b1e3-1473bad779e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0e25337b679d4d05918890a467b40d8f, user_id=43cd4af029a14c30ba19c83958f67f72, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:33.930868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461e20e-4eeb-43e3-b1e3-1473bad779e4 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:34.039758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 577/1153] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:06:33 2022] PUT /identity/v3/projects/0e25337b679d4d05918890a467b40d8f/users/43cd4af029a14c30ba19c83958f67f72/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:06:36.010983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a992c9-4cf0-43e7-a4e7-0cc3065a3300 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:36.011513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a992c9-4cf0-43e7-a4e7-0cc3065a3300 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:36.011513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a992c9-4cf0-43e7-a4e7-0cc3065a3300 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:36.012931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 577/1154] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:36.018221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd76e-7e12-4563-9fd9-e14f8a0c57b5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:36.018631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd76e-7e12-4563-9fd9-e14f8a0c57b5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:36.018771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34cd76e-7e12-4563-9fd9-e14f8a0c57b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:36.037228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d34cd76e-7e12-4563-9fd9-e14f8a0c57b5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:36.038443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d34cd76e-7e12-4563-9fd9-e14f8a0c57b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:36.104037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 578/1155] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 27 18:06:36.126617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a992c9-4cf0-43e7-a4e7-0cc3065a3300 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:36.227000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a992c9-4cf0-43e7-a4e7-0cc3065a3300 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:36.235429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:36.258556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:36.259174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:36.259450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:36.259714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:36.270918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:36.276055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:36.280990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:36.282018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 578/1156] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:36.283951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cd76e-7e12-4563-9fd9-e14f8a0c57b5 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:36.340077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:36.379143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34cd76e-7e12-4563-9fd9-e14f8a0c57b5 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:36.412869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:36.413473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:36.413754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:36.414064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:36.414804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:36.415105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:36.416458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:36.424242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 579/1157] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:36.430281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:36.527568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b0665-7080-4e4d-8e49-0bd2278e559c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:36.559525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:36.560146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:36.560425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:36.560695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] PATH_INFO: `/v3/users/43cd4af029a14c30ba19c83958f67f72` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:36.561866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] RBAC: Authorizing `identity:get_user(user_id=43cd4af029a14c30ba19c83958f67f72)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:36.563283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:36.565049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 579/1158] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:36 2022] GET /identity/v3/users/43cd4af029a14c30ba19c83958f67f72 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:36.570886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:36.667681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd20c226-a2ec-4d75-ac17-c4d546a22986 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:36.689363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:36.701125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:36.701732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:36.706541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:36.706541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:36.766718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:36.768161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:36.861278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 580/1159] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:36.867051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:36.901899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:36.964392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90a39f0-cff8-4f7a-9f73-44841da36cce None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:36.997420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631efae1-2c49-440c-95d2-c68236b3f9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:36.998071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631efae1-2c49-440c-95d2-c68236b3f9d1 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:36.998349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631efae1-2c49-440c-95d2-c68236b3f9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:36.998619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631efae1-2c49-440c-95d2-c68236b3f9d1 None admin] PATH_INFO: `/v3/projects/0e25337b679d4d05918890a467b40d8f` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:36.999798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631efae1-2c49-440c-95d2-c68236b3f9d1 None admin] RBAC: Authorizing `identity:get_project(project_id=0e25337b679d4d05918890a467b40d8f)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:37.001219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631efae1-2c49-440c-95d2-c68236b3f9d1 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:37.002900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 580/1160] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:36 2022] GET /identity/v3/projects/0e25337b679d4d05918890a467b40d8f => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:37.008902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:37.032324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:37.105535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf59deb-ff82-45da-83b9-9ffc1e5c31a0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:37.139403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8886bbe8-ca39-4bbc-b043-1072063d48c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:37.140012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886bbe8-ca39-4bbc-b043-1072063d48c3 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:37.140295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886bbe8-ca39-4bbc-b043-1072063d48c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:37.140569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8886bbe8-ca39-4bbc-b043-1072063d48c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:37.141347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886bbe8-ca39-4bbc-b043-1072063d48c3 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0e25337b679d4d05918890a467b40d8f, user.id=43cd4af029a14c30ba19c83958f67f72) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:37.141657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886bbe8-ca39-4bbc-b043-1072063d48c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:37.143107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8886bbe8-ca39-4bbc-b043-1072063d48c3 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:37.148743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 581/1161] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:37 2022] GET /identity/v3/role_assignments?user.id=43cd4af029a14c30ba19c83958f67f72&scope.project.id=0e25337b679d4d05918890a467b40d8f&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:39.162805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa255-1f92-499c-8858-e9c273ae7e02 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:39.163280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa255-1f92-499c-8858-e9c273ae7e02 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:39.163367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa255-1f92-499c-8858-e9c273ae7e02 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:39.164710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 581/1162] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:39.169703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ccbeb-98a3-4033-858e-87eda3024ffc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:39.170143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ccbeb-98a3-4033-858e-87eda3024ffc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:39.170266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ccbeb-98a3-4033-858e-87eda3024ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:39.187649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bb4ccbeb-98a3-4033-858e-87eda3024ffc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:39.188807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bb4ccbeb-98a3-4033-858e-87eda3024ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:39.252281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 582/1163] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:39.274699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa255-1f92-499c-8858-e9c273ae7e02 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:39.374577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa255-1f92-499c-8858-e9c273ae7e02 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:39.376812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:39.408600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:39.409200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:39.409480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:39.409751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:39.474965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:39.476392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:39.572068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 582/1164] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:39.578627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ccbeb-98a3-4033-858e-87eda3024ffc None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:39.595576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:39.674750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ccbeb-98a3-4033-858e-87eda3024ffc None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:39.707740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fc396b-c6ea-4317-8245-2de7c6f6f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:39.708366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc396b-c6ea-4317-8245-2de7c6f6f41c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:39.708646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc396b-c6ea-4317-8245-2de7c6f6f41c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:39.708921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fc396b-c6ea-4317-8245-2de7c6f6f41c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:39.715433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc396b-c6ea-4317-8245-2de7c6f6f41c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:39.716872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fc396b-c6ea-4317-8245-2de7c6f6f41c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-f0fc396b-c6ea-4317-8245-2de7c6f6f41c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:39.728045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:39.729279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:39.730345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 583/1165] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:06:39 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:39.735137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:39.738163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:39.830251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53790cd-eefd-4656-b61e-25d2f74cdad4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:39.862704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1c1f9-d63a-4bd4-bd99-5a2b20065e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:39.863302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1c1f9-d63a-4bd4-bd99-5a2b20065e5c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:39.863581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1c1f9-d63a-4bd4-bd99-5a2b20065e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:39.863850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1c1f9-d63a-4bd4-bd99-5a2b20065e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:39.864527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1c1f9-d63a-4bd4-bd99-5a2b20065e5c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:39.864829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1c1f9-d63a-4bd4-bd99-5a2b20065e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:39.866211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1c1f9-d63a-4bd4-bd99-5a2b20065e5c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:39.873701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 583/1166] 10.222.0.67 () {56 vars in 1115 bytes} [Wed Jul 27 18:06:39 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:41.834155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363dfa-3f70-4d53-80f4-88d60ee054a9 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:41.834678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363dfa-3f70-4d53-80f4-88d60ee054a9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:41.834770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76363dfa-3f70-4d53-80f4-88d60ee054a9 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:41.836069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 584/1167] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:41.841722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dac68-54b0-49d9-955c-dba7da455a78 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:41.842136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dac68-54b0-49d9-955c-dba7da455a78 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:41.842324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7dac68-54b0-49d9-955c-dba7da455a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:41.860490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-bf7dac68-54b0-49d9-955c-dba7da455a78 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:41.861655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-bf7dac68-54b0-49d9-955c-dba7da455a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:41.921923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:41.927257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 584/1168] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:41.949751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363dfa-3f70-4d53-80f4-88d60ee054a9 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:42.025136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:42.048792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76363dfa-3f70-4d53-80f4-88d60ee054a9 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:42.082432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288039ee-a70b-4638-b1df-4e4f81d017ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:42.083036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288039ee-a70b-4638-b1df-4e4f81d017ec None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:42.083312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288039ee-a70b-4638-b1df-4e4f81d017ec None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:42.083580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288039ee-a70b-4638-b1df-4e4f81d017ec None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:42.084325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288039ee-a70b-4638-b1df-4e4f81d017ec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:42.085627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288039ee-a70b-4638-b1df-4e4f81d017ec None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:42.173261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 585/1169] 10.222.0.67 () {60 vars in 1138 bytes} [Wed Jul 27 18:06:41 2022] POST /identity/v3/domains => generated 267 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:06:44.214676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ff2f-f19c-42d2-91a2-9941e4715291 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:44.215189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ff2f-f19c-42d2-91a2-9941e4715291 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:44.215282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83ff2f-f19c-42d2-91a2-9941e4715291 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:44.216603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 585/1170] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:44.221772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687fd6a-9485-4e9b-9ba6-ffd2d625d8e1 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:44.222139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687fd6a-9485-4e9b-9ba6-ffd2d625d8e1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:44.222349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687fd6a-9485-4e9b-9ba6-ffd2d625d8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:44.239937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6687fd6a-9485-4e9b-9ba6-ffd2d625d8e1 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:44.241109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6687fd6a-9485-4e9b-9ba6-ffd2d625d8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:44.305130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 586/1171] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:44.328784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83ff2f-f19c-42d2-91a2-9941e4715291 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:44.426394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83ff2f-f19c-42d2-91a2-9941e4715291 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:44.458858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f57301-3421-4f82-b463-1f44e14bb7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:44.459477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57301-3421-4f82-b463-1f44e14bb7f6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:44.459755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57301-3421-4f82-b463-1f44e14bb7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:44.460026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57301-3421-4f82-b463-1f44e14bb7f6 None admin] PATH_INFO: `/v3/domains/b8defda0d5ec4fc5a56dbdfca7e0ee42` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:44.470126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f57301-3421-4f82-b463-1f44e14bb7f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b8defda0d5ec4fc5a56dbdfca7e0ee42)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:44.471546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f57301-3421-4f82-b463-1f44e14bb7f6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:44.473130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 586/1172] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Jul 27 18:06:44 2022] GET /identity/v3/domains/b8defda0d5ec4fc5a56dbdfca7e0ee42 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:44.478791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687fd6a-9485-4e9b-9ba6-ffd2d625d8e1 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:44.541208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:44.575968 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687fd6a-9485-4e9b-9ba6-ffd2d625d8e1 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:44.608590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d4d8a-7ca2-44ae-ac68-a41f1ee5bae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:44.609202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4d8a-7ca2-44ae-ac68-a41f1ee5bae9 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:44.609486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4d8a-7ca2-44ae-ac68-a41f1ee5bae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:44.609789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d4d8a-7ca2-44ae-ac68-a41f1ee5bae9 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:44.610566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4d8a-7ca2-44ae-ac68-a41f1ee5bae9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:44.612319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99d4d8a-7ca2-44ae-ac68-a41f1ee5bae9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:44.692140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 587/1173] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:06:44 2022] POST /identity/v3/projects => generated 361 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:06:46.683272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579a2d9-3c84-4be6-a773-28b9b034895e None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:46.683857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579a2d9-3c84-4be6-a773-28b9b034895e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:46.683857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579a2d9-3c84-4be6-a773-28b9b034895e None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:46.685180 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 587/1174] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:46.690527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a472d54-6d13-4eec-b163-b151f6af7de9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:46.690955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a472d54-6d13-4eec-b163-b151f6af7de9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:46.691058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a472d54-6d13-4eec-b163-b151f6af7de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:46.709940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-1a472d54-6d13-4eec-b163-b151f6af7de9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:46.711100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1a472d54-6d13-4eec-b163-b151f6af7de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:46.773515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 588/1175] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:46.797569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579a2d9-3c84-4be6-a773-28b9b034895e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:46.861639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:46.903090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d579a2d9-3c84-4be6-a773-28b9b034895e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:46.934720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe2770b-3bfe-411c-a0d2-07d7ef29a9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:46.935297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2770b-3bfe-411c-a0d2-07d7ef29a9d8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:46.935572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2770b-3bfe-411c-a0d2-07d7ef29a9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:46.935841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe2770b-3bfe-411c-a0d2-07d7ef29a9d8 None admin] PATH_INFO: `/v3/domains/b8defda0d5ec4fc5a56dbdfca7e0ee42` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:46.936977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2770b-3bfe-411c-a0d2-07d7ef29a9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=b8defda0d5ec4fc5a56dbdfca7e0ee42)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:46.938435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe2770b-3bfe-411c-a0d2-07d7ef29a9d8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:46.940020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 588/1176] 10.222.0.67 () {56 vars in 1183 bytes} [Wed Jul 27 18:06:46 2022] GET /identity/v3/domains/b8defda0d5ec4fc5a56dbdfca7e0ee42 => generated 267 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:46.945791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a472d54-6d13-4eec-b163-b151f6af7de9 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:46.993131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:47.043246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a472d54-6d13-4eec-b163-b151f6af7de9 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:47.076847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcb5614-ce1a-4e43-9e91-650d955f33ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:47.077452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5614-ce1a-4e43-9e91-650d955f33ce None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:47.077734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5614-ce1a-4e43-9e91-650d955f33ce None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:47.078044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcb5614-ce1a-4e43-9e91-650d955f33ce None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:47.078727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb5614-ce1a-4e43-9e91-650d955f33ce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:47.080174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcb5614-ce1a-4e43-9e91-650d955f33ce None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:47.165587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 589/1177] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:06:46 2022] POST /identity/v3/users => generated 311 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:06:49.219564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb726d9-31a4-4e5a-bedb-85590f7fc277 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:49.220092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb726d9-31a4-4e5a-bedb-85590f7fc277 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:49.220194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb726d9-31a4-4e5a-bedb-85590f7fc277 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:49.221515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 589/1178] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:49.226637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772bacf-184f-4c98-b81a-c37a92545957 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:49.227016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772bacf-184f-4c98-b81a-c37a92545957 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:49.227192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3772bacf-184f-4c98-b81a-c37a92545957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:49.245272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-3772bacf-184f-4c98-b81a-c37a92545957 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:49.246487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3772bacf-184f-4c98-b81a-c37a92545957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:49.311700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 590/1179] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:49.334858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb726d9-31a4-4e5a-bedb-85590f7fc277 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:49.436865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb726d9-31a4-4e5a-bedb-85590f7fc277 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:49.460648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:49.469424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:49.474258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:49.474258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:49.474258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:49.481359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:49.486227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:49.487404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:49.488327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 590/1180] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:49.493385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772bacf-184f-4c98-b81a-c37a92545957 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:49.525244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:49.590183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3772bacf-184f-4c98-b81a-c37a92545957 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:49.623191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:49.623797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:49.624075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:49.624346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:49.625042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:49.625343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:49.626724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:49.634423 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 591/1181] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:49.640630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:49.737603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342355be-c41a-42c8-b977-116fa9b7912d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:49.769784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:49.770426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:49.770707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:49.770980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] PATH_INFO: `/v3/users/7e1e11df0c334af380a3888dc0264308` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:49.784507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1e11df0c334af380a3888dc0264308)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:49.785963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:49.787570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 591/1182] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:49 2022] GET /identity/v3/users/7e1e11df0c334af380a3888dc0264308 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:49.793156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:49.882605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:49.888718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4e9e68-fcc7-4490-bda7-9b97eb412589 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:49.922429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:49.923027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:49.923302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:49.923570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:49.987534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:49.989005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:50.077091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:50.083268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 592/1183] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:50.089137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:50.134381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:50.187230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b8366-efe4-4fec-8900-a0a81e572ff4 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:50.219917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077e9b9d-b16e-4b28-85a9-eb76f4d33ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:50.220549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e9b9d-b16e-4b28-85a9-eb76f4d33ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:50.220831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e9b9d-b16e-4b28-85a9-eb76f4d33ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:50.221104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077e9b9d-b16e-4b28-85a9-eb76f4d33ed1 None admin] PATH_INFO: `/v3/projects/cce371b361734477a9b3ee61d249ee3d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:50.222412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e9b9d-b16e-4b28-85a9-eb76f4d33ed1 None admin] RBAC: Authorizing `identity:get_project(project_id=cce371b361734477a9b3ee61d249ee3d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:50.223833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077e9b9d-b16e-4b28-85a9-eb76f4d33ed1 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:50.225501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 592/1184] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:50 2022] GET /identity/v3/projects/cce371b361734477a9b3ee61d249ee3d => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:50.231616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:50.327278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a43f13-0c04-4607-8074-a1f38f6c2673 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:50.360463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c652f00c-3888-4831-adcd-203c5dbfa42f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:50.361069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f00c-3888-4831-adcd-203c5dbfa42f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:50.361350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f00c-3888-4831-adcd-203c5dbfa42f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:50.361621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c652f00c-3888-4831-adcd-203c5dbfa42f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:50.362419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652f00c-3888-4831-adcd-203c5dbfa42f None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=cce371b361734477a9b3ee61d249ee3d, user.id=7e1e11df0c334af380a3888dc0264308) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:50.362728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652f00c-3888-4831-adcd-203c5dbfa42f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:50.364155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c652f00c-3888-4831-adcd-203c5dbfa42f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:50.369493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 593/1185] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:50 2022] GET /identity/v3/role_assignments?user.id=7e1e11df0c334af380a3888dc0264308&scope.project.id=cce371b361734477a9b3ee61d249ee3d&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:52.350252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980d3f-5b90-4e54-b674-adfaaf0b1860 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:52.350800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980d3f-5b90-4e54-b674-adfaaf0b1860 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:52.350800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33980d3f-5b90-4e54-b674-adfaaf0b1860 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:52.352135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 593/1186] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:52.358042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d1bd-6278-4973-938e-6c9fa34e7e70 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:52.358437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d1bd-6278-4973-938e-6c9fa34e7e70 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:52.358591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9d1bd-6278-4973-938e-6c9fa34e7e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:52.376083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-31e9d1bd-6278-4973-938e-6c9fa34e7e70 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:52.377193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-31e9d1bd-6278-4973-938e-6c9fa34e7e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:52.431638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:52.442263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 594/1187] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:52.463979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33980d3f-5b90-4e54-b674-adfaaf0b1860 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:52.561193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33980d3f-5b90-4e54-b674-adfaaf0b1860 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:52.574055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:52.594206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:52.594929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:52.595133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:52.595401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:52.605019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:52.610985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:52.612054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:06:52.613054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 594/1188] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:52.618048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9d1bd-6278-4973-938e-6c9fa34e7e70 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:52.712992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9d1bd-6278-4973-938e-6c9fa34e7e70 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:52.745382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:52.746021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:52.746303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:52.746578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:52.747281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:52.747585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:52.748950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:52.756640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 595/1189] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:52.763066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:52.858875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf4198-dc78-4e77-885f-52883e79fd85 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:52.891110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:52.891729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:52.892005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:52.892269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] PATH_INFO: `/v3/users/7e1e11df0c334af380a3888dc0264308` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:52.893389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] RBAC: Authorizing `identity:get_user(user_id=7e1e11df0c334af380a3888dc0264308)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:52.894836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:52.896420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 595/1190] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:52 2022] GET /identity/v3/users/7e1e11df0c334af380a3888dc0264308 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:52.903054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:52.952934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:52.997744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d82276-21f2-4eaa-8d88-efd37cb2ad6e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:53.029719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71724f23-b410-4cb1-94a3-1a1f85fd7301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:53.030371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724f23-b410-4cb1-94a3-1a1f85fd7301 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:53.030647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724f23-b410-4cb1-94a3-1a1f85fd7301 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:53.030914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71724f23-b410-4cb1-94a3-1a1f85fd7301 None admin] PATH_INFO: `/v3/projects/cce371b361734477a9b3ee61d249ee3d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:53.032041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71724f23-b410-4cb1-94a3-1a1f85fd7301 None admin] RBAC: Authorizing `identity:get_project(project_id=cce371b361734477a9b3ee61d249ee3d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:53.033461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71724f23-b410-4cb1-94a3-1a1f85fd7301 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:53.035119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 596/1191] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:52 2022] GET /identity/v3/projects/cce371b361734477a9b3ee61d249ee3d => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:53.040987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:53.082692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:53.139866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc61314-da99-4ab7-82e1-47bade437a6c None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:53.172701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18485fb2-7d61-43c0-ad9d-7d9bd32bf7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:53.173364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485fb2-7d61-43c0-ad9d-7d9bd32bf7f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:53.173636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485fb2-7d61-43c0-ad9d-7d9bd32bf7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:53.173944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485fb2-7d61-43c0-ad9d-7d9bd32bf7f1 None admin] PATH_INFO: `/v3/projects/cce371b361734477a9b3ee61d249ee3d/users/7e1e11df0c334af380a3888dc0264308/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:53.175851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18485fb2-7d61-43c0-ad9d-7d9bd32bf7f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=cce371b361734477a9b3ee61d249ee3d, user_id=7e1e11df0c334af380a3888dc0264308, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:53.177290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18485fb2-7d61-43c0-ad9d-7d9bd32bf7f1 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:53.290419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 596/1192] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:06:53 2022] PUT /identity/v3/projects/cce371b361734477a9b3ee61d249ee3d/users/7e1e11df0c334af380a3888dc0264308/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:06:55.270670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a13f31-023b-4907-a79e-8b6705f8a448 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:55.271206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a13f31-023b-4907-a79e-8b6705f8a448 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:55.271206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a13f31-023b-4907-a79e-8b6705f8a448 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:55.272566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 597/1193] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:06:55.278087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6c0b0-b546-4c34-8a2e-f6224c93781c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:55.278491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6c0b0-b546-4c34-8a2e-f6224c93781c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:55.278675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6c0b0-b546-4c34-8a2e-f6224c93781c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:55.296270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ace6c0b0-b546-4c34-8a2e-f6224c93781c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:06:55.297472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ace6c0b0-b546-4c34-8a2e-f6224c93781c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:06:55.361911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 597/1194] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:06:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:06:55.385046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a13f31-023b-4907-a79e-8b6705f8a448 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:55.485872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a13f31-023b-4907-a79e-8b6705f8a448 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:55.507923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:55.522143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:55.522867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:55.523151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:55.523425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:55.533846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:06:55.538665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:06:55.539728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:06:55.540840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 598/1195] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:06:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:06:55.545961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6c0b0-b546-4c34-8a2e-f6224c93781c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:55.575610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:55.642990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6c0b0-b546-4c34-8a2e-f6224c93781c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:55.676465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:55.677067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:55.677345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:55.677611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:55.678340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:55.678639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:55.679981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:55.687827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 598/1196] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:06:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:55.693584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:55.789461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3d0ad-1945-467d-8498-88bf45c63d5d None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:55.821231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:55.821879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:55.822159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:55.822431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] PATH_INFO: `/v3/users/7e1e11df0c334af380a3888dc0264308` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:55.824118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] RBAC: Authorizing `identity:get_user(user_id=7e1e11df0c334af380a3888dc0264308)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:55.825528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:55.827135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 599/1197] 10.222.0.67 () {56 vars in 1177 bytes} [Wed Jul 27 18:06:55 2022] GET /identity/v3/users/7e1e11df0c334af380a3888dc0264308 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:55.832628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:55.921249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:55.929535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902892f-a126-43e7-bb2a-98484c48e62d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:55.961554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:55.962184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:55.962465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:55.962738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:56.028783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:56.030263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:56.116359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:56.126064 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 599/1198] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:06:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:06:56.131891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:56.179634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:06:56.228760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2909a005-47f1-4810-9fa6-4de9cc2e42a8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:56.265824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49bbd31-d158-44c0-9762-b379136f8e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:56.266450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbd31-d158-44c0-9762-b379136f8e57 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:56.266731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbd31-d158-44c0-9762-b379136f8e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:56.267004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49bbd31-d158-44c0-9762-b379136f8e57 None admin] PATH_INFO: `/v3/projects/cce371b361734477a9b3ee61d249ee3d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:56.268139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bbd31-d158-44c0-9762-b379136f8e57 None admin] RBAC: Authorizing `identity:get_project(project_id=cce371b361734477a9b3ee61d249ee3d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:56.269572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49bbd31-d158-44c0-9762-b379136f8e57 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:56.271270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 600/1199] 10.222.0.67 () {56 vars in 1186 bytes} [Wed Jul 27 18:06:56 2022] GET /identity/v3/projects/cce371b361734477a9b3ee61d249ee3d => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:06:56.277698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:06:56.373222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39283b4a-8ea7-4dfa-b855-719e1af3c3ff None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:06:56.407014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76280eca-b3a7-4244-a9a6-3c34b8d34d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:06:56.407615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280eca-b3a7-4244-a9a6-3c34b8d34d01 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:06:56.407894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280eca-b3a7-4244-a9a6-3c34b8d34d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:06:56.408165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76280eca-b3a7-4244-a9a6-3c34b8d34d01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:06:56.408965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280eca-b3a7-4244-a9a6-3c34b8d34d01 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=cce371b361734477a9b3ee61d249ee3d, user.id=7e1e11df0c334af380a3888dc0264308) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:06:56.409273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280eca-b3a7-4244-a9a6-3c34b8d34d01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:06:56.410789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76280eca-b3a7-4244-a9a6-3c34b8d34d01 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:06:56.416503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 600/1200] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:06:56 2022] GET /identity/v3/role_assignments?user.id=7e1e11df0c334af380a3888dc0264308&scope.project.id=cce371b361734477a9b3ee61d249ee3d&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:07:06.261124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=42 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:07:06.413996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=72 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:13.113908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ec27-711f-49f1-a0a0-459ab450a02a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:13.114361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ec27-711f-49f1-a0a0-459ab450a02a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:13.114509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a647ec27-711f-49f1-a0a0-459ab450a02a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:13.115874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 601/1201] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:13.121044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f012ca7-97d7-4d84-ae5a-e41a9b0c78e4 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:13.121433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f012ca7-97d7-4d84-ae5a-e41a9b0c78e4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:13.121591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f012ca7-97d7-4d84-ae5a-e41a9b0c78e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:13.139278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6f012ca7-97d7-4d84-ae5a-e41a9b0c78e4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:13.140438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6f012ca7-97d7-4d84-ae5a-e41a9b0c78e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:13.206308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 601/1202] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:13.232723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ec27-711f-49f1-a0a0-459ab450a02a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:13.334982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a647ec27-711f-49f1-a0a0-459ab450a02a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:13.368168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:13.368741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:13.369022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:13.369296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:13.379022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:13.380464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:13.395449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:13.396738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:13.397974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:13.397974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:13.397974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:13.397974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:13.397974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 602/1203] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:13.402882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f012ca7-97d7-4d84-ae5a-e41a9b0c78e4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:13.499972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f012ca7-97d7-4d84-ae5a-e41a9b0c78e4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:13.528229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:13.534698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659ab8a0-53ae-41a2-8d7a-a66ebf5a41de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:13.538972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab8a0-53ae-41a2-8d7a-a66ebf5a41de None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:13.538972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab8a0-53ae-41a2-8d7a-a66ebf5a41de None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:13.538972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659ab8a0-53ae-41a2-8d7a-a66ebf5a41de None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:13.538972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ab8a0-53ae-41a2-8d7a-a66ebf5a41de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:13.538972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ab8a0-53ae-41a2-8d7a-a66ebf5a41de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:13.538972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659ab8a0-53ae-41a2-8d7a-a66ebf5a41de None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:13.549159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 602/1204] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:13.554932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:13.608264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:13.655781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d565ff18-4784-4da6-8635-1061f756c1f0 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:13.688752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b066c7ca-d104-42b2-bcb6-bbd7fbba566a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:13.689364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c7ca-d104-42b2-bcb6-bbd7fbba566a None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:13.689641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c7ca-d104-42b2-bcb6-bbd7fbba566a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:13.689945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b066c7ca-d104-42b2-bcb6-bbd7fbba566a None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:13.690620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066c7ca-d104-42b2-bcb6-bbd7fbba566a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:13.692096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b066c7ca-d104-42b2-bcb6-bbd7fbba566a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:13.856850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 603/1205] 10.222.0.67 () {60 vars in 1132 bytes} [Wed Jul 27 18:08:13 2022] POST /identity/v3/users => generated 251 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:08:15.879011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96438aa2-e86c-4ce0-a61e-0db60c19aaea None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:15.879538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96438aa2-e86c-4ce0-a61e-0db60c19aaea None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:15.879538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96438aa2-e86c-4ce0-a61e-0db60c19aaea None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:15.880926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 603/1206] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:15.886011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf0a8-1a65-4649-a5ea-97eb2ebd191c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:15.886436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf0a8-1a65-4649-a5ea-97eb2ebd191c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:15.886549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4bf0a8-1a65-4649-a5ea-97eb2ebd191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:15.905036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bc4bf0a8-1a65-4649-a5ea-97eb2ebd191c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:15.906235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bc4bf0a8-1a65-4649-a5ea-97eb2ebd191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:15.970041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 604/1207] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:15.992594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96438aa2-e86c-4ce0-a61e-0db60c19aaea None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:16.093626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96438aa2-e86c-4ce0-a61e-0db60c19aaea None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:16.127340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:16.127976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:16.128254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:16.128526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:16.138982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:08:16.144710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:16.145882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:16.146986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 604/1208] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:08:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:16.151934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bf0a8-1a65-4649-a5ea-97eb2ebd191c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:16.189724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:16.245150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4bf0a8-1a65-4649-a5ea-97eb2ebd191c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:16.279173 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:16.279903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:16.280175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:16.280442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:16.281139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:16.281568 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:16.282955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:16.291203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 605/1209] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:08:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:16.296849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:16.345851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:16.394881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdbe2ff-d083-489a-ada9-a88b60b16bcb None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:16.426619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:16.427232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:16.427513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:16.427778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:16.438392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:16.439763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:16.453264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:16.454468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:16.455833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:16.455833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:16.455833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:16.455833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:16.455833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 605/1210] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:16.460189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:16.556661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:16.559499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031b867-5caa-40b5-8b6b-b1a7cfee4a5e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:16.591998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:16.592609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:16.592883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:16.593149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:16.593900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:16.594415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:16.596438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:16.607605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 606/1211] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:16.613991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:16.712461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d3232-5fb4-4a85-a23e-b6bf3c4515fd None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:16.713947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:16.745904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:16.746529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:16.746808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:16.747082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:16.754255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:16.755689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:08:16.766791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:16.767941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:16.769113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 606/1212] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:16.774077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:16.878223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5431e7f7-20b1-4e13-bd79-5673c89a441e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:16.914301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:16.915054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:16.915199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:16.915472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:16.916261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:16.916568 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:16.918040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:16.936477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 607/1213] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 18:08:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:16.942541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:17.051982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8921265-b7b0-45d0-903b-a77331998ef8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:17.084980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:17.085637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:17.085956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:17.086235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:17.118342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:17.155122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:17.157164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:17.252358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 607/1214] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:08:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:08:17.258139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:17.277200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:17.354682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66aa42c-4007-4f5f-a9b3-b9e842b35262 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:17.387210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:17.387832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:17.388105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:17.388371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:17.398744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:17.400171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:17.414710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:17.415841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:17.417185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:17.417185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:17.417185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:17.417185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:17.417185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 608/1215] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:17.421791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:17.484454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:17.522758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78ec48e-bb54-4650-ab0d-c39f0353f971 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:17.555300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:17.555914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:17.556194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:17.556468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:17.557195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:17.557498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:17.558901 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:17.571142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 608/1216] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:17.576777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:17.650723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:17.681005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7026fc49-b839-4549-aad8-44fe65bc55ee None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:17.714651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:17.715295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:17.715577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:17.715854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:17.722371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:17.723814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:08:17.735182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:17.736220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:17.737498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 609/1217] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:17.742281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:17.842140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50ca53-75ca-45e2-ac18-cf84f9b08a7b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:17.864066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:17.875005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fa3840-471b-44f7-ae97-5fea94cbf086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:17.876141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa3840-471b-44f7-ae97-5fea94cbf086 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:17.876414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa3840-471b-44f7-ae97-5fea94cbf086 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:17.876679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fa3840-471b-44f7-ae97-5fea94cbf086 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:17.877408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa3840-471b-44f7-ae97-5fea94cbf086 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:17.877704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa3840-471b-44f7-ae97-5fea94cbf086 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:17.879140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fa3840-471b-44f7-ae97-5fea94cbf086 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:17.890507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 609/1218] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:08:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:17.896826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:17.993094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf4853-ef13-4539-8b71-6cbc24be63a3 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:18.021055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:18.026661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176c56c-4151-4c1b-b1ee-87b4e9124aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:18.027262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c56c-4151-4c1b-b1ee-87b4e9124aba None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:18.027538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c56c-4151-4c1b-b1ee-87b4e9124aba None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:18.027809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176c56c-4151-4c1b-b1ee-87b4e9124aba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:18.028578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176c56c-4151-4c1b-b1ee-87b4e9124aba None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8bd7c735f47f4810a8a6e3e52adbb756) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:18.028880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176c56c-4151-4c1b-b1ee-87b4e9124aba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:18.030341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a176c56c-4151-4c1b-b1ee-87b4e9124aba None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:18.035586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 610/1219] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:08:17 2022] GET /identity/v3/role_assignments?user.id=8bd7c735f47f4810a8a6e3e52adbb756&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:20.056792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22c9b-37c4-4589-a122-6730c2572ec4 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.057346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22c9b-37c4-4589-a122-6730c2572ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.057346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22c9b-37c4-4589-a122-6730c2572ec4 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.058761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 610/1220] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:20.064102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d83a4-be2a-4939-9bdb-81681e2f49ee None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.064519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d83a4-be2a-4939-9bdb-81681e2f49ee None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.064689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d83a4-be2a-4939-9bdb-81681e2f49ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.083032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6a4d83a4-be2a-4939-9bdb-81681e2f49ee None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:20.084328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6a4d83a4-be2a-4939-9bdb-81681e2f49ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:20.150643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 611/1221] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:20.173278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22c9b-37c4-4589-a122-6730c2572ec4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:20.274246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22c9b-37c4-4589-a122-6730c2572ec4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:20.310822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:20.311413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.311691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.312185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.326014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:08:20.332390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:20.333505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:20.334632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 611/1222] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:08:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:20.339703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d83a4-be2a-4939-9bdb-81681e2f49ee None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:20.436649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d83a4-be2a-4939-9bdb-81681e2f49ee None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:20.460385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:20.471386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:20.472006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.472286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.472561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.473293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:20.473597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:20.475045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:20.482775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 612/1223] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:08:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:20.489403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:20.534675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:20.588467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525c852f-4eb5-45f8-87ca-6ae2d404b2d3 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:20.621871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:20.622505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.622802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.623056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.632919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:20.634405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:20.648942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:20.650048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:20.651318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:20.651318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:20.651318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:20.651318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:20.651318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 612/1224] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:20.655843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:20.755905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bea37-0a0b-4598-bc4b-04d644e565a9 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:20.788408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:20.789012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.789289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.789558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.790266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:20.790567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:20.791926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:20.804043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 613/1225] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:20.809724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:20.901599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:20.908423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494b87e4-fca5-40be-9561-2759b8f99ee5 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:20.940580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:20.941212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:20.941494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:20.941787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:20.949137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:20.950690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:08:20.962117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:20.963052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:20.964030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 613/1226] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:20.969574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:21.015944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:21.067243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ed9ac9-320d-4043-aba9-6b3e0f4dc5df None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:21.100373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:21.101029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:21.101303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:21.101571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:21.102483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:21.102784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:21.104205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:21.121403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 614/1227] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 18:08:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:21.127148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:21.226989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae425a41-6ddb-4c1c-aebb-25697b33200b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:21.261148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:21.261792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:21.262081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:21.262354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:21.273514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:21.274997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:21.289845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:21.290931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:21.292038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:21.292038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:21.292038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:21.292038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:21.292038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 614/1228] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:21.298363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:21.396395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b997675-a833-4d65-bd3e-c86fad1dd79f None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:21.398660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:21.430526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:21.431147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:21.431431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:21.431708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:21.432394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:21.432707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:21.434212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:21.445780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 615/1229] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:21.451660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:21.461493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:21.551065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f37f5b-7f81-4b72-8ded-b5a0fd29d666 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:21.584557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:21.585193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:21.585475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:21.585748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:21.592392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:21.594107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:08:21.605119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:21.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:21.607044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 615/1230] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:21.612637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:21.715710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8076f04-6521-4778-b243-c629ecfbe9e1 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:21.750534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2836cb03-baa2-4a9e-863a-a3cc45ac9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:21.751161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cb03-baa2-4a9e-863a-a3cc45ac9c7a None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:21.751440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cb03-baa2-4a9e-863a-a3cc45ac9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:21.751714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2836cb03-baa2-4a9e-863a-a3cc45ac9c7a None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:21.752450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cb03-baa2-4a9e-863a-a3cc45ac9c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:21.752756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cb03-baa2-4a9e-863a-a3cc45ac9c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:21.754250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2836cb03-baa2-4a9e-863a-a3cc45ac9c7a None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:21.770893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 616/1231] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:21.776822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:21.841097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:21.874584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa00ae-62a1-4b17-83a0-52e2c7765a14 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:21.907486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39ab9-4665-4c81-95f7-661542baabf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:21.908148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39ab9-4665-4c81-95f7-661542baabf8 None admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:21.908457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39ab9-4665-4c81-95f7-661542baabf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:21.908731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39ab9-4665-4c81-95f7-661542baabf8 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8bd7c735f47f4810a8a6e3e52adbb756/roles/fde07f9dcebb4680a98ab1f9c8d97c2a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:21.923029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39ab9-4665-4c81-95f7-661542baabf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=8bd7c735f47f4810a8a6e3e52adbb756, role_id=fde07f9dcebb4680a98ab1f9c8d97c2a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:21.924455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39ab9-4665-4c81-95f7-661542baabf8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:22.036398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 616/1232] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:08:21 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8bd7c735f47f4810a8a6e3e52adbb756/roles/fde07f9dcebb4680a98ab1f9c8d97c2a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:08:24.028520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8115-e02d-4674-a800-8c063c7e0d63 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:24.029071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8115-e02d-4674-a800-8c063c7e0d63 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:24.029071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c8115-e02d-4674-a800-8c063c7e0d63 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:24.030431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 617/1233] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:24.035581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890010c-281e-4541-a8c3-3b2d7ce68ab0 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:24.035980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890010c-281e-4541-a8c3-3b2d7ce68ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:24.036131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c890010c-281e-4541-a8c3-3b2d7ce68ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:24.054322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c890010c-281e-4541-a8c3-3b2d7ce68ab0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:24.055505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c890010c-281e-4541-a8c3-3b2d7ce68ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:24.122676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 617/1234] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:24.147403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8115-e02d-4674-a800-8c063c7e0d63 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:24.172513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:24.246042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c8115-e02d-4674-a800-8c063c7e0d63 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:24.279169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:24.279810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:24.280081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:24.280347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:24.290739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:08:24.295569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:24.297334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:24.298246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 618/1235] 10.222.0.67 () {56 vars in 1102 bytes} [Wed Jul 27 18:08:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:24.303611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890010c-281e-4541-a8c3-3b2d7ce68ab0 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:24.348848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:24.399709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c890010c-281e-4541-a8c3-3b2d7ce68ab0 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:24.442048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:24.442661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:24.442939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:24.443209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:24.443907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] RBAC: Adding query filter params (name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:24.444207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:24.445564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:24.453215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 618/1236] 10.222.0.67 () {56 vars in 1103 bytes} [Wed Jul 27 18:08:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:24.459135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:24.544557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:24.560223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f193cf7-b2aa-47de-9042-7b273d6a7b1c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:24.592149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:24.592772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:24.593047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:24.594153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:24.603655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:24.605090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:24.619118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:24.620137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:24.621250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:24.621250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:24.621250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:24.621250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:24.621250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 619/1237] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:24.626243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:24.724176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e178026b-d5b3-43dc-8742-dd74d352da9e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:24.732981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:24.756685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:24.757319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:24.757598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:24.757892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:24.758565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:24.758859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:24.760197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:24.772286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 619/1238] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:24.778111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:24.877342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403bf1d3-4267-415e-8c26-d807c24a8c80 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:24.913713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:24.914374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:24.914657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:24.914931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:24.917547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:24.922461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:24.923936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:08:24.935057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:24.936138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:24.937137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:24.942215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 620/1239] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:24.942582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:25.038968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599cd70-4944-4e1e-bb0b-ed853d2d240a None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:25.072719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:25.073331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:25.073609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:25.073915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:25.074702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:25.075005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:25.076418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:25.093703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 620/1240] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 18:08:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:25.099739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:25.199955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a48d5b5-9a34-4371-95b0-ca54f225499c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:25.233119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:25.233736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:25.234054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:25.234331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:25.293715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:25.300697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:25.302232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:25.400429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 621/1241] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:08:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:08:25.406327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:25.433509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:25.502775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a69fd27-e5aa-4117-b189-662a05ff07d6 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:25.538165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:25.538800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:25.539081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:25.539355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:25.549333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:25.550988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:25.566363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:25.567430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:25.568564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:25.568564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:25.568564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:25.568564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:25.568564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 621/1242] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:25.573455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:25.666087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:25.671754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976dec56-334e-4596-b2d7-655d74b9d9f8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:25.705007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:25.706049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:25.706551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:25.707052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:25.708286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:25.708835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:25.710627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:25.721654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 622/1243] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:25.727571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:25.804962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:25.826182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047d6971-c093-4197-a011-a702ccb70be7 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:25.858560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:25.859179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:25.859452 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:25.859739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:25.866108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:25.871123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:08:25.880767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:25.882316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:25.883877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:25.885915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 622/1244] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:08:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:25.888966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:25.986475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8deb1-1262-4a64-aecd-b0f2b1b81709 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:26.021750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e4693-3cad-45a0-9e03-00a19cf876fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:26.022388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e4693-3cad-45a0-9e03-00a19cf876fe None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:26.022663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e4693-3cad-45a0-9e03-00a19cf876fe None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:26.022929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e4693-3cad-45a0-9e03-00a19cf876fe None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:26.023658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e4693-3cad-45a0-9e03-00a19cf876fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:26.023957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e4693-3cad-45a0-9e03-00a19cf876fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:26.025476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e4693-3cad-45a0-9e03-00a19cf876fe None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:26.037457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 623/1245] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:26.043735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:26.146677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc18e9a5-e124-435f-92c3-b8f05f47f2dc None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:26.179543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde459c7-68fa-41b3-885e-93f54b6d05e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:26.180149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde459c7-68fa-41b3-885e-93f54b6d05e2 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:26.180426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde459c7-68fa-41b3-885e-93f54b6d05e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:26.180698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde459c7-68fa-41b3-885e-93f54b6d05e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:26.181470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde459c7-68fa-41b3-885e-93f54b6d05e2 None admin] RBAC: Adding query filter params (role.id=fde07f9dcebb4680a98ab1f9c8d97c2a, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8bd7c735f47f4810a8a6e3e52adbb756) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:26.181799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde459c7-68fa-41b3-885e-93f54b6d05e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:26.183261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde459c7-68fa-41b3-885e-93f54b6d05e2 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:26.189508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 623/1246] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:08:26 2022] GET /identity/v3/role_assignments?user.id=8bd7c735f47f4810a8a6e3e52adbb756&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=fde07f9dcebb4680a98ab1f9c8d97c2a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:08:28.221730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fb69-aa4b-4c9b-973a-3f57f6dbc3e0 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:28.222294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fb69-aa4b-4c9b-973a-3f57f6dbc3e0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:28.222417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe5fb69-aa4b-4c9b-973a-3f57f6dbc3e0 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:28.223670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 624/1247] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:28.228775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a882-bcf6-4031-b8ce-fa1ce78e7f3c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:28.229195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a882-bcf6-4031-b8ce-fa1ce78e7f3c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:28.229325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63a882-bcf6-4031-b8ce-fa1ce78e7f3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:28.236308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:28.248024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ae63a882-bcf6-4031-b8ce-fa1ce78e7f3c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:28.251398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ae63a882-bcf6-4031-b8ce-fa1ce78e7f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:28.315077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 624/1248] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:28.338449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5fb69-aa4b-4c9b-973a-3f57f6dbc3e0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:28.356938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:28.438347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe5fb69-aa4b-4c9b-973a-3f57f6dbc3e0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:28.470792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:28.471415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:28.471692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:28.471965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:28.481550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:08:28.486456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:28.487544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:28.488653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 625/1249] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:08:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:28.493874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63a882-bcf6-4031-b8ce-fa1ce78e7f3c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:28.590806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63a882-bcf6-4031-b8ce-fa1ce78e7f3c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:28.619440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:28.624369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:28.624983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:28.625263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:28.625538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:28.626357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:28.626660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:28.628104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:28.635971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 625/1250] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:08:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:28.642599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:28.719529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:28.741138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbb3259-e3eb-4e4b-8b8a-f2f3c11b6fc2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:28.774756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:28.775388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:28.775664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:28.775933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:28.786145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:28.787695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:28.802117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:28.815098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:28.816215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:28.816215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:28.816215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:28.816215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:28.816215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 626/1251] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:28.816572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:28.908325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9aa521-5c28-4777-b30b-0a3348281261 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:28.941313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:28.941946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:28.942222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:28.942491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:28.943162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:28.943460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:28.944807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:28.956717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 626/1252] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:28.962449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:29.064314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f4cadb-0314-4cbb-9b6b-3fbf4c418429 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:29.090004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:29.097592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:29.098684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:29.098684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:29.098911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:29.106537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:29.107999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:08:29.119687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:29.120907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:29.122175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 627/1253] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:29.128048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:29.182225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:29.225008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9b1f3d-4ea2-4df1-a15d-a77fa56b43e0 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:29.258220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:29.258859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:29.259093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:29.259365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:29.260141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:29.260444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:29.261894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:29.280442 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 627/1254] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 18:08:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:29.286383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:29.388516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be90f7d9-95df-4d68-913a-d0a6b673ff3e None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:29.423478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:29.424101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:29.424383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:29.424661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:29.480464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:29.492974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:29.494460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:29.590119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 628/1255] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:08:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:08:29.596397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:29.694014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4bd5c-3a4f-43e6-82d2-232bfe5a174d None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:29.706764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:29.728219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:29.728849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:29.729133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:29.729405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:29.739839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:29.741262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:29.756957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:29.767572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:29.768492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:29.768492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:29.768492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:29.768492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:29.768492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 628/1256] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:29.769107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:29.853245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:29.864739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501b85b-3bbe-408b-b9cd-30cf3bebd5d8 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:29.898922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:29.899535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:29.899813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:29.900085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:29.900760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:29.901061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:29.902451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:29.913881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 629/1257] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:29.919546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:30.017235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e235e469-aad8-4206-80ef-2ae8e4bd3eb8 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:30.050459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:30.051094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:30.051376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:30.051644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] PATH_INFO: `/v3/projects/service` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:30.058235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:30.059662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:08:30.070870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:30.071896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:30.072989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 629/1258] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:08:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:30.077985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:30.178665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b05cc-50f9-4415-99d1-e3ea880e5d78 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:30.212320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7320140-5990-4777-81a5-85ee2edffb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:30.212934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320140-5990-4777-81a5-85ee2edffb87 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:30.213216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320140-5990-4777-81a5-85ee2edffb87 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:30.213487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7320140-5990-4777-81a5-85ee2edffb87 None admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:30.214306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7320140-5990-4777-81a5-85ee2edffb87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:30.214635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7320140-5990-4777-81a5-85ee2edffb87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:30.216053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7320140-5990-4777-81a5-85ee2edffb87 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:30.227862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 630/1259] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:08:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:30.234210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:30.260156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:30.333681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5f937-cd39-4076-95d4-6a8d47cb70be None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:30.367478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f582-2795-4306-bdc5-a7679400edef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:30.368092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f582-2795-4306-bdc5-a7679400edef None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:30.368370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f582-2795-4306-bdc5-a7679400edef None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:30.368639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f582-2795-4306-bdc5-a7679400edef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:30.369412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f582-2795-4306-bdc5-a7679400edef None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8bd7c735f47f4810a8a6e3e52adbb756) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:30.369717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f582-2795-4306-bdc5-a7679400edef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:30.371154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f582-2795-4306-bdc5-a7679400edef None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:30.377089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 630/1260] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:08:30 2022] GET /identity/v3/role_assignments?user.id=8bd7c735f47f4810a8a6e3e52adbb756&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:32.365372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f9d3-74e6-45f5-af73-1533f9c8092a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:32.365893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f9d3-74e6-45f5-af73-1533f9c8092a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:32.365893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a98f9d3-74e6-45f5-af73-1533f9c8092a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:32.367252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 631/1261] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:08:32.372468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d549-6612-471f-b294-4c0afd9af54c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:32.372895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d549-6612-471f-b294-4c0afd9af54c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:32.373044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b022d549-6612-471f-b294-4c0afd9af54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:32.391479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b022d549-6612-471f-b294-4c0afd9af54c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:32.392678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b022d549-6612-471f-b294-4c0afd9af54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:32.459856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 631/1262] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:32.482821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98f9d3-74e6-45f5-af73-1533f9c8092a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:32.494766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:32.584043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a98f9d3-74e6-45f5-af73-1533f9c8092a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:32.618036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:32.618618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:32.618902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:32.619182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:32.629092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:08:32.634062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:32.635183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:32.636255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 632/1263] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:08:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 27 18:08:32.641353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d549-6612-471f-b294-4c0afd9af54c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:32.660407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:32.739102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b022d549-6612-471f-b294-4c0afd9af54c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:32.772640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:32.773248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:32.773530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:32.773875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:32.774580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] RBAC: Adding query filter params (name=admin) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:32.774880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:32.776234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:32.784595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 632/1264] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:08:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:32.790300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:32.858215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:32.891686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faff092-46e0-47cc-b606-cc9d8a1dce19 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:32.924475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:32.925101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:32.925378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:32.925646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:32.935762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:32.937220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:32.950832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:32.951915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:32.952914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:32.952914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:32.952914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:32.952914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:32.952914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 633/1265] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:32.958298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:33.038051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:33.055980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95925cb-3932-400c-9159-57df53a08aad None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:33.088034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:33.088639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:33.088915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:33.089187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:33.089898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:33.090200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:33.091557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:33.104638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 633/1266] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:33.110447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:33.210917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c256d1-0441-4b5a-987d-32205bf97504 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:33.233165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:33.246767 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:33.247403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:33.247685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:33.247959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:33.255960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:33.257435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:08:33.269562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:33.270609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:33.271698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 634/1267] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:33.276680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:33.374672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9caed6-903b-43f6-9247-164201adb95b None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:33.410628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:33.411228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:33.411507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:33.411776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:33.412560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:33.412866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:33.414364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:33.422929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:33.431560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 634/1268] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 18:08:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:33.437222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:33.540011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548526de-00f1-45d6-9048-0da8b76397ff None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:33.573636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:33.574299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:33.574582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:33.574856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:33.585092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:33.586569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:33.600407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:33.604620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:33.605518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:33.605518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:33.605518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:33.605518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:33.605518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 635/1269] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:33.607531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:33.707018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f0ce0-8dac-4e73-9f3b-92a5f7064348 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:33.740322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:33.740930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:33.741211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:33.741483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:33.742193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:33.742496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:33.743843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:33.755651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 635/1270] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:33.761315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:33.793026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:33.863915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecf1628-e2a4-436f-baf0-0a82ebc47e27 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:33.898227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:33.898860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:33.899142 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:33.899413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:33.905995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:33.907434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:08:33.918581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:33.919663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:33.920768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 636/1271] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:33.926227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:33.984269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:34.024871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ea388a-edd6-4bb9-8d69-aaaffdcdc28e None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:34.057597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2540f-c8ab-4dac-a27f-df46700b3ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:34.058176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2540f-c8ab-4dac-a27f-df46700b3ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:34.058460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2540f-c8ab-4dac-a27f-df46700b3ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:34.058735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2540f-c8ab-4dac-a27f-df46700b3ad7 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:34.059477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2540f-c8ab-4dac-a27f-df46700b3ad7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:34.059783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2540f-c8ab-4dac-a27f-df46700b3ad7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:34.061205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2540f-c8ab-4dac-a27f-df46700b3ad7 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:34.073393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 636/1272] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:34.080112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:34.173952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:34.182388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891bfd33-9fb7-4667-801c-24e87dcc27ce None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:34.218469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22423b91-365d-4c1d-81e9-9d1831abd417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:34.219249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22423b91-365d-4c1d-81e9-9d1831abd417 None admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:34.219546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22423b91-365d-4c1d-81e9-9d1831abd417 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:34.219825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22423b91-365d-4c1d-81e9-9d1831abd417 None admin] PATH_INFO: `/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8bd7c735f47f4810a8a6e3e52adbb756/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:34.221810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22423b91-365d-4c1d-81e9-9d1831abd417 None admin] RBAC: Authorizing `identity:create_grant(project_id=0cf0ac49dc804d21bbd0073993b309cc, user_id=8bd7c735f47f4810a8a6e3e52adbb756, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:34.223249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22423b91-365d-4c1d-81e9-9d1831abd417 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:34.319636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 637/1273] 10.222.0.67 () {58 vars in 1439 bytes} [Wed Jul 27 18:08:34 2022] PUT /identity/v3/projects/0cf0ac49dc804d21bbd0073993b309cc/users/8bd7c735f47f4810a8a6e3e52adbb756/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:08:36.286984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbddb7-e509-4e6b-9251-c1d14025fc1a None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:36.287501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbddb7-e509-4e6b-9251-c1d14025fc1a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:36.287597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbbddb7-e509-4e6b-9251-c1d14025fc1a None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:36.289001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 637/1274] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:36.294299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c5bcb-2783-4257-80f7-2fcf85544dfc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:36.294692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c5bcb-2783-4257-80f7-2fcf85544dfc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:36.294964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830c5bcb-2783-4257-80f7-2fcf85544dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:36.313296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-830c5bcb-2783-4257-80f7-2fcf85544dfc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:36.314530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-830c5bcb-2783-4257-80f7-2fcf85544dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:36.380447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 638/1275] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:36.403568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbddb7-e509-4e6b-9251-c1d14025fc1a None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:36.509799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbbddb7-e509-4e6b-9251-c1d14025fc1a None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:36.526860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:36.543742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:36.544376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:36.544656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:36.544926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:36.555390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 27 18:08:36.560391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:36.562680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:36.563708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 638/1276] 10.222.0.67 () {56 vars in 1096 bytes} [Wed Jul 27 18:08:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:36.567692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c5bcb-2783-4257-80f7-2fcf85544dfc None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:36.646091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:36.663503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830c5bcb-2783-4257-80f7-2fcf85544dfc None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:36.695755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:36.696363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:36.696647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:36.696916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:36.697614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:36.697954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:36.699408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:36.707586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 639/1277] 10.222.0.67 () {56 vars in 1099 bytes} [Wed Jul 27 18:08:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:36.713424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:36.812428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abfb4a7-a32f-4f08-a438-8e75247cbf21 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:36.845469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:36.846115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:36.846389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:36.846653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:36.856935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:36.858387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:36.872425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:36.873586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:36.874690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:36.874690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:36.874690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:36.874690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:36.874690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 639/1278] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:36.879468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:36.979217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d781ea6a-8055-4e88-bec1-7642b9b7cfe2 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:37.011411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:37.012052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:37.012333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:37.012916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:37.013333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:37.013639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:37.015045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:37.027561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 640/1279] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:37.033498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:37.064681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:37.132770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fd5dc-357b-441b-b3a2-e59ddca76c01 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:37.168390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:37.169031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:37.169311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:37.169587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:37.177169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:37.178758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 27 18:08:37.190706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:37.191860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:37.192869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 640/1280] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:37.198061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:37.201844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:37.295866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260e43e6-6333-4c46-9da5-fa1f61aa550c None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:37.329098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:37.329806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:37.330094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:37.330377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:37.331159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:37.331489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:37.332881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:37.349615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 641/1281] 10.222.0.67 () {56 vars in 1143 bytes} [Wed Jul 27 18:08:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:37.355531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:37.447863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:37.457388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969b8d4-609a-45c3-9af7-e774a7d99a11 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:37.490257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:37.490872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:37.491154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:37.491429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:37.556512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:37.557891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:37.646784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:37.655217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 641/1282] 10.222.0.67 () {58 vars in 1282 bytes} [Wed Jul 27 18:08:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 27 18:08:37.661239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:37.721579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:37.758557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d292f7a8-a3d3-4120-8d54-70d8c0e717d3 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:37.793584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:37.794255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:37.794526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:37.794797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:37.805623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:37.807126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 27 18:08:37.820610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:37.824022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:37.825135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 27 18:08:37.825135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 27 18:08:37.825135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 27 18:08:37.825135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:37.825135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 642/1283] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:37.827638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:37.926545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14f3f9-61fe-4ae7-bc20-41e0433ab5bf None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:37.959959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:37.960569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:37.960850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:37.961124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:37.961831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:37.962135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:37.963487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:37.975105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 642/1284] 10.222.0.67 () {56 vars in 1109 bytes} [Wed Jul 27 18:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:37.981941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:38.080064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88720ab9-b5a9-4912-97e6-20a0da298b22 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:38.093079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:38.113961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:38.114604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:38.114877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:38.115141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:38.121708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:38.123164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 27 18:08:38.134373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:38.135264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: ERROR keystone.server.flask.application Jul 27 18:08:38.136222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 643/1285] 10.222.0.67 () {56 vars in 1111 bytes} [Wed Jul 27 18:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:38.141983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:38.191461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:38.240129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45fa70b-604e-4012-847b-fac2c87e7254 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:38.272835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b5dac7-a81f-4988-9282-a0ac636536d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:38.273446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5dac7-a81f-4988-9282-a0ac636536d9 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:38.273724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5dac7-a81f-4988-9282-a0ac636536d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:38.274028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b5dac7-a81f-4988-9282-a0ac636536d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:38.274769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5dac7-a81f-4988-9282-a0ac636536d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:38.275071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5dac7-a81f-4988-9282-a0ac636536d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:38.276480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b5dac7-a81f-4988-9282-a0ac636536d9 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:38.288130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 643/1286] 10.222.0.67 () {56 vars in 1148 bytes} [Wed Jul 27 18:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:08:38.294323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:38.395065 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315b5c93-4af2-48b2-bca4-c93f5a7f7381 None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:38.429686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc2dd92-a8b1-4e1d-a675-ba36d2530494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:38.430334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dd92-a8b1-4e1d-a675-ba36d2530494 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:38.430615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dd92-a8b1-4e1d-a675-ba36d2530494 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:38.430890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc2dd92-a8b1-4e1d-a675-ba36d2530494 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:38.431672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2dd92-a8b1-4e1d-a675-ba36d2530494 None admin] RBAC: Adding query filter params (role.id=3e04c3350d96492f859c4b4fce594b16, scope.project.id=0cf0ac49dc804d21bbd0073993b309cc, user.id=8bd7c735f47f4810a8a6e3e52adbb756) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:38.431982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2dd92-a8b1-4e1d-a675-ba36d2530494 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:38.433417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc2dd92-a8b1-4e1d-a675-ba36d2530494 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:38.440057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 644/1287] 10.222.0.67 () {56 vars in 1374 bytes} [Wed Jul 27 18:08:38 2022] GET /identity/v3/role_assignments?user.id=8bd7c735f47f4810a8a6e3e52adbb756&scope.project.id=0cf0ac49dc804d21bbd0073993b309cc&role.id=3e04c3350d96492f859c4b4fce594b16 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:40.447910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6efb-d7b9-4d2d-a3a9-d8e41107e78f None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:40.448470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6efb-d7b9-4d2d-a3a9-d8e41107e78f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:40.448470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227c6efb-d7b9-4d2d-a3a9-d8e41107e78f None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:40.449779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 644/1288] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:40.455246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af2f2e-dc63-4eba-b2f2-7d9ba336982e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:40.455638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af2f2e-dc63-4eba-b2f2-7d9ba336982e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:40.455791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af2f2e-dc63-4eba-b2f2-7d9ba336982e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:40.474248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-38af2f2e-dc63-4eba-b2f2-7d9ba336982e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:40.475468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-38af2f2e-dc63-4eba-b2f2-7d9ba336982e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:40.504528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:40.541854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 645/1289] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:40.563415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6efb-d7b9-4d2d-a3a9-d8e41107e78f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:40.664281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227c6efb-d7b9-4d2d-a3a9-d8e41107e78f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:40.674498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:40.696951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:40.700972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:40.700972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:40.700972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:40.700972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:40.700972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:40.709143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:40.710469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:40.711619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 645/1290] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:08:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:40.716292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af2f2e-dc63-4eba-b2f2-7d9ba336982e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:40.813077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af2f2e-dc63-4eba-b2f2-7d9ba336982e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:40.846709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745ba1e7-1966-4590-8060-72115d69ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:40.847401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba1e7-1966-4590-8060-72115d69ab73 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:40.847622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba1e7-1966-4590-8060-72115d69ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:40.847889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ba1e7-1966-4590-8060-72115d69ab73 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:40.848547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ba1e7-1966-4590-8060-72115d69ab73 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:40.848844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ba1e7-1966-4590-8060-72115d69ab73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:40.850224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745ba1e7-1966-4590-8060-72115d69ab73 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:40.854951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 646/1291] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 18:08:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:40.860710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:40.958870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58edd22-e31f-4ccf-9c7e-9c68c76f9326 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:40.991157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5c6585-a11f-4959-a551-d7d03c24f962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:40.991765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6585-a11f-4959-a551-d7d03c24f962 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:40.992048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6585-a11f-4959-a551-d7d03c24f962 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:40.992321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5c6585-a11f-4959-a551-d7d03c24f962 None admin] PATH_INFO: `/v3/services` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:40.992988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6585-a11f-4959-a551-d7d03c24f962 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:40.993291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6585-a11f-4959-a551-d7d03c24f962 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:40.994682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5c6585-a11f-4959-a551-d7d03c24f962 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:40.999003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 646/1292] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 18:08:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:43.005024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b327bf-40df-4855-a763-d9e0a6ac2a43 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:43.005554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b327bf-40df-4855-a763-d9e0a6ac2a43 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:43.005554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b327bf-40df-4855-a763-d9e0a6ac2a43 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:43.006978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 647/1293] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:43.012020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8433811-f471-4c67-949a-0894055dfd1d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:43.012387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8433811-f471-4c67-949a-0894055dfd1d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:43.012576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8433811-f471-4c67-949a-0894055dfd1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:43.031260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c8433811-f471-4c67-949a-0894055dfd1d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:43.032457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c8433811-f471-4c67-949a-0894055dfd1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:43.062326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:43.099202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 647/1294] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:43.122235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b327bf-40df-4855-a763-d9e0a6ac2a43 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:43.153316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:43.222139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b327bf-40df-4855-a763-d9e0a6ac2a43 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:43.255800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa73a785-5504-41ab-8278-51f5c42c9be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:43.256350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73a785-5504-41ab-8278-51f5c42c9be5 None admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:43.256632 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73a785-5504-41ab-8278-51f5c42c9be5 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:43.256908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa73a785-5504-41ab-8278-51f5c42c9be5 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:43.257599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73a785-5504-41ab-8278-51f5c42c9be5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:43.258976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa73a785-5504-41ab-8278-51f5c42c9be5 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:43.411946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 648/1295] 10.222.0.67 () {60 vars in 1141 bytes} [Wed Jul 27 18:08:43 2022] POST /identity/v3/services => generated 246 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:08:45.392324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd23e1-ac71-4446-bdd3-3cb78030abc7 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:45.393085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd23e1-ac71-4446-bdd3-3cb78030abc7 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:45.393085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd23e1-ac71-4446-bdd3-3cb78030abc7 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:45.394461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 648/1296] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:08:45.399647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f68c5-f469-41e7-aaaa-41f53fca7e65 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:45.401580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f68c5-f469-41e7-aaaa-41f53fca7e65 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:45.401580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f68c5-f469-41e7-aaaa-41f53fca7e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:45.417840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8c0f68c5-f469-41e7-aaaa-41f53fca7e65 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:45.419049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8c0f68c5-f469-41e7-aaaa-41f53fca7e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:45.490234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 649/1297] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:45.513067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd23e1-ac71-4446-bdd3-3cb78030abc7 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:45.615588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd23e1-ac71-4446-bdd3-3cb78030abc7 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:45.649655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:45.650260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:45.650531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:45.650800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:45.651414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:45.652781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:45.661460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:45.666715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:45.667820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 649/1298] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:08:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:45.668970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f68c5-f469-41e7-aaaa-41f53fca7e65 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:45.687960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:45.767027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f68c5-f469-41e7-aaaa-41f53fca7e65 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:45.799749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:45.800368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:45.800650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:45.800926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:45.801594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:45.801937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:45.803301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:45.808302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 650/1299] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 18:08:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:08:45.814909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:45.846630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:45.912580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6645e324-77a6-4a83-9494-c4d2b0006493 None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:45.946768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d7211-64ae-4777-ac8b-43c73a31d4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:45.947369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d7211-64ae-4777-ac8b-43c73a31d4c4 None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:45.947644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d7211-64ae-4777-ac8b-43c73a31d4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:45.947910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d7211-64ae-4777-ac8b-43c73a31d4c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:45.948647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d7211-64ae-4777-ac8b-43c73a31d4c4 None admin] RBAC: Adding query filter params (interface=public, service_id=51eeb8b2b03745d0ab261e24d4fc36d0, region_id=RegionOne) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:45.948950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d7211-64ae-4777-ac8b-43c73a31d4c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:45.950332 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d7211-64ae-4777-ac8b-43c73a31d4c4 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:45.955333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 650/1300] 10.222.0.67 () {56 vars in 1251 bytes} [Wed Jul 27 18:08:45 2022] GET /identity/v3/endpoints?service_id=51eeb8b2b03745d0ab261e24d4fc36d0&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:45.961250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:46.040512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:46.059033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749f95b1-40d8-46f7-b89a-49440080e56b None admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:46.092491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee72e55-ba06-432e-845b-4f5b15268a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:46.093643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee72e55-ba06-432e-845b-4f5b15268a5c None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:46.093954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee72e55-ba06-432e-845b-4f5b15268a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:46.094224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee72e55-ba06-432e-845b-4f5b15268a5c None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:46.094864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee72e55-ba06-432e-845b-4f5b15268a5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:46.096224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee72e55-ba06-432e-845b-4f5b15268a5c None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:46.103101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 651/1301] 10.222.0.67 () {56 vars in 1087 bytes} [Wed Jul 27 18:08:45 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:08:48.117865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c61c-3efd-49ef-bad0-aa018415bb80 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:48.118346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c61c-3efd-49ef-bad0-aa018415bb80 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:48.118450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c61c-3efd-49ef-bad0-aa018415bb80 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:48.119773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 651/1302] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:08:48.125623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805764f-8465-4a70-8220-76dd6de7ec44 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:48.126060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805764f-8465-4a70-8220-76dd6de7ec44 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:48.126305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b805764f-8465-4a70-8220-76dd6de7ec44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:48.144552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b805764f-8465-4a70-8220-76dd6de7ec44 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:08:48.145741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b805764f-8465-4a70-8220-76dd6de7ec44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:08:48.211271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 652/1303] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:08:48 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 27 18:08:48.234630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c61c-3efd-49ef-bad0-aa018415bb80 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:48.328297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:48.334937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c61c-3efd-49ef-bad0-aa018415bb80 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:48.368253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:48.368828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:48.369106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:48.369382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] PATH_INFO: `/v3/services/placement` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:48.370068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:48.371429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 27 18:08:48.380316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 27 18:08:48.381565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.get_or_create( Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application with Lock( Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self._enter() Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application return self.creator() Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application created_value = creator( Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: ERROR keystone.server.flask.application Jul 27 18:08:48.382662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 652/1304] 10.222.0.67 () {56 vars in 1117 bytes} [Wed Jul 27 18:08:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 27 18:08:48.387852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805764f-8465-4a70-8220-76dd6de7ec44 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:48.462310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:48.484996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b805764f-8465-4a70-8220-76dd6de7ec44 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:48.516643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83cc81e-8c8f-47be-b777-e254e95953e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:48.517248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc81e-8c8f-47be-b777-e254e95953e8 None admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:48.517822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc81e-8c8f-47be-b777-e254e95953e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:48.518103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83cc81e-8c8f-47be-b777-e254e95953e8 None admin] PATH_INFO: `/v3/services` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:48.518778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cc81e-8c8f-47be-b777-e254e95953e8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:08:48.519673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cc81e-8c8f-47be-b777-e254e95953e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:48.521072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83cc81e-8c8f-47be-b777-e254e95953e8 None admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:48.526353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 653/1305] 10.222.0.67 () {56 vars in 1116 bytes} [Wed Jul 27 18:08:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:08:48.532777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:08:48.634077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86fa9f6-21b1-4c69-ab9f-e040fa58c5ec None admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:08:48.668096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568dd3d1-6167-413b-bf01-aa2aeff1a135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:08:48.668703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dd3d1-6167-413b-bf01-aa2aeff1a135 None admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:08:48.668985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dd3d1-6167-413b-bf01-aa2aeff1a135 None admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:08:48.669259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568dd3d1-6167-413b-bf01-aa2aeff1a135 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:08:48.669995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dd3d1-6167-413b-bf01-aa2aeff1a135 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:08:48.671391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568dd3d1-6167-413b-bf01-aa2aeff1a135 None admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:08:48.759121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 653/1306] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:08:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:08:58.588487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=30 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:08:58.754700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:35.923554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7c1a-2338-472b-a107-4f74c0dbd99b None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:35.924123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7c1a-2338-472b-a107-4f74c0dbd99b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:35.924123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fe7c1a-2338-472b-a107-4f74c0dbd99b None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:35.929882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 654/1307] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:35.931487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05711661-5aa0-45e9-8172-d7aff497cbb5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:35.931932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05711661-5aa0-45e9-8172-d7aff497cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:35.932133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05711661-5aa0-45e9-8172-d7aff497cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:36.123326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-05711661-5aa0-45e9-8172-d7aff497cbb5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:36.124557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-05711661-5aa0-45e9-8172-d7aff497cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:36.356797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 654/1308] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:36.425939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2fb48-ba08-4de3-88bd-a7895131ec63 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:36.426520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2fb48-ba08-4de3-88bd-a7895131ec63 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:36.426978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f2fb48-ba08-4de3-88bd-a7895131ec63 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:36.429035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 655/1309] 10.222.0.67 () {54 vars in 965 bytes} [Wed Jul 27 18:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:36.435432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ddf8-6db9-4ae2-b349-ddc2fe152046 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:36.435708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ddf8-6db9-4ae2-b349-ddc2fe152046 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:36.436019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e9ddf8-6db9-4ae2-b349-ddc2fe152046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:36.553237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-21e9ddf8-6db9-4ae2-b349-ddc2fe152046 None None] MFA Rules not processed for user `052da4ed2e054c70ba8b0bf9b6c5656a`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:36.554816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-21e9ddf8-6db9-4ae2-b349-ddc2fe152046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:36.583177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:36.653089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 655/1310] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Jul 27 18:15:36 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:36.662229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2fb48-ba08-4de3-88bd-a7895131ec63 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:36.664280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-16f2fb48-ba08-4de3-88bd-a7895131ec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:36.784165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f2fb48-ba08-4de3-88bd-a7895131ec63 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:36.886594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eb524f-c875-4020-a3fa-c78bafef6f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:36.887141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb524f-c875-4020-a3fa-c78bafef6f2f service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:36.887417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb524f-c875-4020-a3fa-c78bafef6f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:36.887688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eb524f-c875-4020-a3fa-c78bafef6f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:36.889337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a7eb524f-c875-4020-a3fa-c78bafef6f2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:36.952681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:37.021673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb524f-c875-4020-a3fa-c78bafef6f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:37.023255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eb524f-c875-4020-a3fa-c78bafef6f2f service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:37.045618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 656/1311] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:15:39.400508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80525e5-10d0-4d87-becb-e62c5916cd77 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:39.401017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80525e5-10d0-4d87-becb-e62c5916cd77 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:39.401017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80525e5-10d0-4d87-becb-e62c5916cd77 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:39.402401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 656/1312] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:39.407790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08ab0-221d-460e-9d54-44c973f696e8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:39.408219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08ab0-221d-460e-9d54-44c973f696e8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:39.408348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b08ab0-221d-460e-9d54-44c973f696e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:39.479715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d0b08ab0-221d-460e-9d54-44c973f696e8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:39.481115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d0b08ab0-221d-460e-9d54-44c973f696e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:39.581108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 657/1313] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:39.620825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80525e5-10d0-4d87-becb-e62c5916cd77 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:39.622458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d80525e5-10d0-4d87-becb-e62c5916cd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:39.735808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80525e5-10d0-4d87-becb-e62c5916cd77 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:39.811237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:39.813743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd838-5468-4286-ba83-7022c75cfd7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:39.814388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd838-5468-4286-ba83-7022c75cfd7d service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:39.814669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd838-5468-4286-ba83-7022c75cfd7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:39.814943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd838-5468-4286-ba83-7022c75cfd7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:39.816554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0b6bd838-5468-4286-ba83-7022c75cfd7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:39.927537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd838-5468-4286-ba83-7022c75cfd7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:39.928994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd838-5468-4286-ba83-7022c75cfd7d service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:39.948154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 657/1314] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:15:42.479524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477233d-b681-4663-bc7c-0e314c97f6d8 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:42.480040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477233d-b681-4663-bc7c-0e314c97f6d8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:42.480163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477233d-b681-4663-bc7c-0e314c97f6d8 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:42.481449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 658/1315] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:42.486524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bb036-f8f8-4c87-b635-b6411da55bcd None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:42.486938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bb036-f8f8-4c87-b635-b6411da55bcd None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:42.487068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93bb036-f8f8-4c87-b635-b6411da55bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:42.552863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c93bb036-f8f8-4c87-b635-b6411da55bcd None None] MFA Rules not processed for user `34e0b348981c423682cfee52e46660f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:42.554100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c93bb036-f8f8-4c87-b635-b6411da55bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:42.606463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:42.650057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 658/1316] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:42 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:42.689415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477233d-b681-4663-bc7c-0e314c97f6d8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:42.690979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2477233d-b681-4663-bc7c-0e314c97f6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:42.700743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:42.792241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477233d-b681-4663-bc7c-0e314c97f6d8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:42.864017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e836bb3-06b1-498a-9329-0816d84cb10b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:42.864628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836bb3-06b1-498a-9329-0816d84cb10b service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:42.864915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836bb3-06b1-498a-9329-0816d84cb10b service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:42.865189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e836bb3-06b1-498a-9329-0816d84cb10b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:42.866821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1e836bb3-06b1-498a-9329-0816d84cb10b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:42.928732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:42.973813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e836bb3-06b1-498a-9329-0816d84cb10b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:42.975837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e836bb3-06b1-498a-9329-0816d84cb10b service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:42.994070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 659/1317] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:42 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:15:45.836337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e212-bc68-4a7d-ac70-afcca601aa92 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:45.836878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e212-bc68-4a7d-ac70-afcca601aa92 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:45.836976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e733e212-bc68-4a7d-ac70-afcca601aa92 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:45.838334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 659/1318] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:45.843534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4b05d-4bd4-4f90-91f4-7692b7556279 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:45.843964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4b05d-4bd4-4f90-91f4-7692b7556279 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:45.844117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4b05d-4bd4-4f90-91f4-7692b7556279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:45.910043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-52e4b05d-4bd4-4f90-91f4-7692b7556279 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:45.911251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-52e4b05d-4bd4-4f90-91f4-7692b7556279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:46.003854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 660/1319] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:46.042547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733e212-bc68-4a7d-ac70-afcca601aa92 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:46.044041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e733e212-bc68-4a7d-ac70-afcca601aa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:46.146370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e733e212-bc68-4a7d-ac70-afcca601aa92 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:46.217911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6894f48a-9d36-443c-b49c-49365c8478ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:46.218549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894f48a-9d36-443c-b49c-49365c8478ec service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:46.218826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894f48a-9d36-443c-b49c-49365c8478ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:46.219094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6894f48a-9d36-443c-b49c-49365c8478ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:46.220692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6894f48a-9d36-443c-b49c-49365c8478ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:46.228519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:46.328101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894f48a-9d36-443c-b49c-49365c8478ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:46.329518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6894f48a-9d36-443c-b49c-49365c8478ec service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:46.348003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 660/1320] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:15:49.308646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb676ee-d144-4847-b404-38093bb7db32 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:49.309193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb676ee-d144-4847-b404-38093bb7db32 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:49.309193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb676ee-d144-4847-b404-38093bb7db32 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:49.310709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 661/1321] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:49.315916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184c883-700e-4a5f-9981-7e442d930b37 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:49.316319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184c883-700e-4a5f-9981-7e442d930b37 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:49.316464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7184c883-700e-4a5f-9981-7e442d930b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:49.382067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7184c883-700e-4a5f-9981-7e442d930b37 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:49.383188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7184c883-700e-4a5f-9981-7e442d930b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:49.444242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:49.483695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 661/1322] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:49.532996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c166e-feca-410c-90b1-79b38c417eee None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:49.533279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c166e-feca-410c-90b1-79b38c417eee None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:49.533550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c166e-feca-410c-90b1-79b38c417eee None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:49.534966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 662/1323] 10.222.0.67 () {54 vars in 965 bytes} [Wed Jul 27 18:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:49.541414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96952f7-00fd-4d0f-96fa-ddf326799fba None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:49.541698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96952f7-00fd-4d0f-96fa-ddf326799fba None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:49.542063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96952f7-00fd-4d0f-96fa-ddf326799fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:49.618119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b96952f7-00fd-4d0f-96fa-ddf326799fba None None] MFA Rules not processed for user `052da4ed2e054c70ba8b0bf9b6c5656a`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:49.619362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b96952f7-00fd-4d0f-96fa-ddf326799fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:49.703349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 662/1324] 10.222.0.67 () {58 vars in 1062 bytes} [Wed Jul 27 18:15:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:15:49.712459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c166e-feca-410c-90b1-79b38c417eee None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:49.714107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-595c166e-feca-410c-90b1-79b38c417eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:49.734725 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:49.825512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c166e-feca-410c-90b1-79b38c417eee None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:49.899348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab58408-3172-40a7-8f02-9a9a98cca980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:49.899981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab58408-3172-40a7-8f02-9a9a98cca980 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:49.900262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab58408-3172-40a7-8f02-9a9a98cca980 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:49.900532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab58408-3172-40a7-8f02-9a9a98cca980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:49.902187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5ab58408-3172-40a7-8f02-9a9a98cca980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:49.972928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:50.010267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab58408-3172-40a7-8f02-9a9a98cca980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:50.012094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab58408-3172-40a7-8f02-9a9a98cca980 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:50.031606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 663/1325] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:15:52.332703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426fea4-7be9-4797-a7c8-e6d39e33e42c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:52.333783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426fea4-7be9-4797-a7c8-e6d39e33e42c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:52.333897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5426fea4-7be9-4797-a7c8-e6d39e33e42c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:52.335324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 663/1326] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:52.340535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80062a-612a-471f-89c8-bc601d99e3e5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:52.340927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80062a-612a-471f-89c8-bc601d99e3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:52.341116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80062a-612a-471f-89c8-bc601d99e3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:52.407768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8e80062a-612a-471f-89c8-bc601d99e3e5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:52.408911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8e80062a-612a-471f-89c8-bc601d99e3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:52.511403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 664/1327] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:52.555994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426fea4-7be9-4797-a7c8-e6d39e33e42c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:52.557640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5426fea4-7be9-4797-a7c8-e6d39e33e42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:52.620369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:52.664872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5426fea4-7be9-4797-a7c8-e6d39e33e42c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:52.751327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b0b2cc-57ec-4b55-8729-d9083404a04e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:52.752939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0b2cc-57ec-4b55-8729-d9083404a04e service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:52.752939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0b2cc-57ec-4b55-8729-d9083404a04e service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:52.752939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b0b2cc-57ec-4b55-8729-d9083404a04e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:52.754057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e9b0b2cc-57ec-4b55-8729-d9083404a04e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:52.860642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:52.863064 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0b2cc-57ec-4b55-8729-d9083404a04e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:52.865011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b0b2cc-57ec-4b55-8729-d9083404a04e service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:52.884143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 664/1328] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:15:54.924537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0082a3-4952-4ee0-a794-5b7ebceeeee8 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:54.925105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0082a3-4952-4ee0-a794-5b7ebceeeee8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:54.925211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0082a3-4952-4ee0-a794-5b7ebceeeee8 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:54.927241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 665/1329] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:54.932917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dec941-3002-49dc-9bb8-221308fb69a9 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:54.933431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dec941-3002-49dc-9bb8-221308fb69a9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:54.933546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dec941-3002-49dc-9bb8-221308fb69a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:55.001270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e9dec941-3002-49dc-9bb8-221308fb69a9 None None] MFA Rules not processed for user `34e0b348981c423682cfee52e46660f4`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:55.002481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e9dec941-3002-49dc-9bb8-221308fb69a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:55.096274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 665/1330] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:15:55.134084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0082a3-4952-4ee0-a794-5b7ebceeeee8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:55.135649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7d0082a3-4952-4ee0-a794-5b7ebceeeee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:55.168242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:55.240440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0082a3-4952-4ee0-a794-5b7ebceeeee8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:55.312864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47655b51-a78b-44ab-a910-56a25611545a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:55.313478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b51-a78b-44ab-a910-56a25611545a service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:55.313745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b51-a78b-44ab-a910-56a25611545a service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:55.314044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47655b51-a78b-44ab-a910-56a25611545a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:55.315868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-47655b51-a78b-44ab-a910-56a25611545a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:55.414242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:55.448983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655b51-a78b-44ab-a910-56a25611545a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:55.450599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47655b51-a78b-44ab-a910-56a25611545a service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:55.475043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 666/1331] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:15:58.204522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103514a-a8ff-43e7-8138-03e1355094e5 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:58.205102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103514a-a8ff-43e7-8138-03e1355094e5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:58.205102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c103514a-a8ff-43e7-8138-03e1355094e5 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:58.206767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 666/1332] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:15:58.212322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54d17-57c4-4ed3-8586-113ae3eed754 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:58.212887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54d17-57c4-4ed3-8586-113ae3eed754 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:58.212887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab54d17-57c4-4ed3-8586-113ae3eed754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:58.279787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-aab54d17-57c4-4ed3-8586-113ae3eed754 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:15:58.280987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-aab54d17-57c4-4ed3-8586-113ae3eed754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:58.377081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 667/1333] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:15:58.414417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103514a-a8ff-43e7-8138-03e1355094e5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:15:58.415926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c103514a-a8ff-43e7-8138-03e1355094e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:58.484482 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:58.517740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c103514a-a8ff-43e7-8138-03e1355094e5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:15:58.590172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea089cb-1940-4db5-83e6-0b496def1ff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:15:58.590801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea089cb-1940-4db5-83e6-0b496def1ff5 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:15:58.591081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea089cb-1940-4db5-83e6-0b496def1ff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:15:58.591343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea089cb-1940-4db5-83e6-0b496def1ff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:15:58.592934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4ea089cb-1940-4db5-83e6-0b496def1ff5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:15:58.700203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea089cb-1940-4db5-83e6-0b496def1ff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:15:58.701593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea089cb-1940-4db5-83e6-0b496def1ff5 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:15:58.712253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:15:58.720266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 667/1334] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:00.774034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564194b-f3a5-46a6-8ae2-ef9a61b6e070 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:00.774627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564194b-f3a5-46a6-8ae2-ef9a61b6e070 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:00.774627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564194b-f3a5-46a6-8ae2-ef9a61b6e070 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:00.775955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 668/1335] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:00.781093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782e5d-ff10-4b66-a6a0-d86bce7a2472 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:00.781489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782e5d-ff10-4b66-a6a0-d86bce7a2472 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:00.781666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5782e5d-ff10-4b66-a6a0-d86bce7a2472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:00.846273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b5782e5d-ff10-4b66-a6a0-d86bce7a2472 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:00.847493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b5782e5d-ff10-4b66-a6a0-d86bce7a2472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:00.943595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 668/1336] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:00.983607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564194b-f3a5-46a6-8ae2-ef9a61b6e070 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:00.985179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b564194b-f3a5-46a6-8ae2-ef9a61b6e070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:01.024577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:01.086700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564194b-f3a5-46a6-8ae2-ef9a61b6e070 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:01.158421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb12ef9-0244-4b8a-976d-f8924449e88d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:01.159039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb12ef9-0244-4b8a-976d-f8924449e88d service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:01.159317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb12ef9-0244-4b8a-976d-f8924449e88d service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:01.159587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb12ef9-0244-4b8a-976d-f8924449e88d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:01.161206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5bb12ef9-0244-4b8a-976d-f8924449e88d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:01.243495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:01.269261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb12ef9-0244-4b8a-976d-f8924449e88d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:01.270896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb12ef9-0244-4b8a-976d-f8924449e88d service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:01.289317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 669/1337] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:04.132388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b07781-1abc-439b-80ee-5e67ba4e0f03 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:04.132839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b07781-1abc-439b-80ee-5e67ba4e0f03 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:04.132948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b07781-1abc-439b-80ee-5e67ba4e0f03 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:04.134396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 669/1338] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:04.139488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745b3f7-224b-46a2-9ddb-e63a93e0441d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:04.139922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745b3f7-224b-46a2-9ddb-e63a93e0441d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:04.140028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3745b3f7-224b-46a2-9ddb-e63a93e0441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:04.203763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-3745b3f7-224b-46a2-9ddb-e63a93e0441d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:04.204945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3745b3f7-224b-46a2-9ddb-e63a93e0441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:04.298880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 670/1339] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:04 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:04.335367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b07781-1abc-439b-80ee-5e67ba4e0f03 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:04.336893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-44b07781-1abc-439b-80ee-5e67ba4e0f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:04.414588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:04.441335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b07781-1abc-439b-80ee-5e67ba4e0f03 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:04.513338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1152dbd-047c-4773-af25-576f3209efe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:04.513981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152dbd-047c-4773-af25-576f3209efe9 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:04.514263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152dbd-047c-4773-af25-576f3209efe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:04.516053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1152dbd-047c-4773-af25-576f3209efe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:04.516150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d1152dbd-047c-4773-af25-576f3209efe9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:04.621982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152dbd-047c-4773-af25-576f3209efe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:04.623330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1152dbd-047c-4773-af25-576f3209efe9 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:04.642618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 670/1340] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:08.873033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a0ab2-047c-4c62-ae6c-efa69ca97ed3 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:08.873547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a0ab2-047c-4c62-ae6c-efa69ca97ed3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:08.873547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a0ab2-047c-4c62-ae6c-efa69ca97ed3 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:08.875313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 671/1341] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:08.880681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1c76-d8c0-4287-988f-ab12c6287a84 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:08.881162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1c76-d8c0-4287-988f-ab12c6287a84 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:08.881271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cee1c76-d8c0-4287-988f-ab12c6287a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:08.887246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:08.951960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4cee1c76-d8c0-4287-988f-ab12c6287a84 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:08.953168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4cee1c76-d8c0-4287-988f-ab12c6287a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:09.057834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 671/1342] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:09.095946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a0ab2-047c-4c62-ae6c-efa69ca97ed3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:09.097478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cc5a0ab2-047c-4c62-ae6c-efa69ca97ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:09.149732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:09.204403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a0ab2-047c-4c62-ae6c-efa69ca97ed3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:09.277200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e0d3e-c7ef-4239-82d7-90619cde276b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:09.277744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e0d3e-c7ef-4239-82d7-90619cde276b service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:09.278050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e0d3e-c7ef-4239-82d7-90619cde276b service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:09.278322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e0d3e-c7ef-4239-82d7-90619cde276b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:09.279951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2b2e0d3e-c7ef-4239-82d7-90619cde276b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:09.371604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:09.388126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e0d3e-c7ef-4239-82d7-90619cde276b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:09.389570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e0d3e-c7ef-4239-82d7-90619cde276b service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:09.408972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 672/1343] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:12.353222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9dbb-4601-4388-89fc-1a4bb1a60ac4 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:12.353753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9dbb-4601-4388-89fc-1a4bb1a60ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:12.353753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d9dbb-4601-4388-89fc-1a4bb1a60ac4 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:12.355189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 672/1344] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:12.360314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2499f7-f1a9-4795-95c0-96dbe35a799c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:12.360720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2499f7-f1a9-4795-95c0-96dbe35a799c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:12.360870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2499f7-f1a9-4795-95c0-96dbe35a799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:12.427633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ba2499f7-f1a9-4795-95c0-96dbe35a799c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:12.428869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ba2499f7-f1a9-4795-95c0-96dbe35a799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:12.526418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 673/1345] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:12 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:12.564211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9dbb-4601-4388-89fc-1a4bb1a60ac4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:12.565740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6c9d9dbb-4601-4388-89fc-1a4bb1a60ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:12.658832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:12.675927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d9dbb-4601-4388-89fc-1a4bb1a60ac4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:12.751310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97480b1a-cc81-4e36-ba4a-4213cf84c99c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:12.751929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97480b1a-cc81-4e36-ba4a-4213cf84c99c service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:12.752213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97480b1a-cc81-4e36-ba4a-4213cf84c99c service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:12.752486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97480b1a-cc81-4e36-ba4a-4213cf84c99c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:12.754129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-97480b1a-cc81-4e36-ba4a-4213cf84c99c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:12.865232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97480b1a-cc81-4e36-ba4a-4213cf84c99c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:12.866671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97480b1a-cc81-4e36-ba4a-4213cf84c99c service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:12.885694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 673/1346] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:12 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:17.047341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ba4c0-dbd6-4155-945f-d31170712ce7 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:17.047784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ba4c0-dbd6-4155-945f-d31170712ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:17.047883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502ba4c0-dbd6-4155-945f-d31170712ce7 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:17.049911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 674/1347] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:17.055095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e54f5-daef-4031-88f5-e5bba9e92fe4 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:17.055574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e54f5-daef-4031-88f5-e5bba9e92fe4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:17.055802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630e54f5-daef-4031-88f5-e5bba9e92fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:17.072164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:17.132304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-630e54f5-daef-4031-88f5-e5bba9e92fe4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:17.133529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-630e54f5-daef-4031-88f5-e5bba9e92fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:17.235366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 674/1348] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:17.274305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ba4c0-dbd6-4155-945f-d31170712ce7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:17.275902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-502ba4c0-dbd6-4155-945f-d31170712ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:17.454502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:17.506699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502ba4c0-dbd6-4155-945f-d31170712ce7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:17.585072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72dfdb-9d22-43c7-8fad-304e482f305c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:17.585692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dfdb-9d22-43c7-8fad-304e482f305c service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:17.586020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dfdb-9d22-43c7-8fad-304e482f305c service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:17.586269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72dfdb-9d22-43c7-8fad-304e482f305c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:17.587866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ec72dfdb-9d22-43c7-8fad-304e482f305c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:17.703280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:17.706705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72dfdb-9d22-43c7-8fad-304e482f305c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:17.708146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec72dfdb-9d22-43c7-8fad-304e482f305c service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:17.727228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 675/1349] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:22.692796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab791ca-2a4d-4f7d-a1d0-5017c112e364 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:22.693333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab791ca-2a4d-4f7d-a1d0-5017c112e364 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:22.693430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab791ca-2a4d-4f7d-a1d0-5017c112e364 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:22.695215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 675/1350] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:22.700359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a818-d584-42f1-9cbf-23ec3f542212 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:22.700777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a818-d584-42f1-9cbf-23ec3f542212 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:22.700907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a818-d584-42f1-9cbf-23ec3f542212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:22.838693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e931a818-d584-42f1-9cbf-23ec3f542212 None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:22.840123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e931a818-d584-42f1-9cbf-23ec3f542212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:22.959422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 676/1351] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:16:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:27.048626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ade4d6-b35a-4d7d-a768-255f8634c100 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:27.049123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ade4d6-b35a-4d7d-a768-255f8634c100 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:27.049123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ade4d6-b35a-4d7d-a768-255f8634c100 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:27.050665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 676/1352] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:16:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:27.056675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61553e-6576-480c-9f69-d6ad70171359 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:27.057496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61553e-6576-480c-9f69-d6ad70171359 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:27.057978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d61553e-6576-480c-9f69-d6ad70171359 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:27.123376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:27.147728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9d61553e-6576-480c-9f69-d6ad70171359 None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:27.149186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9d61553e-6576-480c-9f69-d6ad70171359 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:27.233556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=59 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:27.280315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 677/1353] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:16:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:28.569930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491c6a-38ad-40b5-bc34-170f8c6aeeca None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:28.570472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491c6a-38ad-40b5-bc34-170f8c6aeeca None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:28.570472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d491c6a-38ad-40b5-bc34-170f8c6aeeca None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:28.571900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 677/1354] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:28.577468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce323b3-7d34-41c7-b470-8a04d98fc563 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:28.577981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce323b3-7d34-41c7-b470-8a04d98fc563 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:28.578140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce323b3-7d34-41c7-b470-8a04d98fc563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:28.657514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-3ce323b3-7d34-41c7-b470-8a04d98fc563 None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:28.658800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3ce323b3-7d34-41c7-b470-8a04d98fc563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:28.717673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:28.791947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 678/1355] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:16:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:32.273529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5366-6283-42a5-9771-2adbd5995ea3 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:32.274418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5366-6283-42a5-9771-2adbd5995ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:32.274847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab5366-6283-42a5-9771-2adbd5995ea3 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:32.280787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 678/1356] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:32.282714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449afde-8020-49ed-9436-b10e4449676c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:32.283164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449afde-8020-49ed-9436-b10e4449676c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:32.283269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e449afde-8020-49ed-9436-b10e4449676c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:32.365426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e449afde-8020-49ed-9436-b10e4449676c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:32.366982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e449afde-8020-49ed-9436-b10e4449676c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:32.471217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 679/1357] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:32.528636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcbe2c-822f-48b4-bf3a-abd336e3321b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:32.529310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcbe2c-822f-48b4-bf3a-abd336e3321b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:32.529837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dcbe2c-822f-48b4-bf3a-abd336e3321b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:32.531885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 679/1358] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 18:16:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:32.540127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1be9b-d107-417c-b84d-ccfd6bdaee37 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:32.540419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1be9b-d107-417c-b84d-ccfd6bdaee37 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:32.540697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1be9b-d107-417c-b84d-ccfd6bdaee37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:32.559907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:32.624301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-f6b1be9b-d107-417c-b84d-ccfd6bdaee37 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:32.625853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f6b1be9b-d107-417c-b84d-ccfd6bdaee37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:32.743382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 680/1359] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 18:16:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:32.751301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcbe2c-822f-48b4-bf3a-abd336e3321b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:32.752950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b2dcbe2c-822f-48b4-bf3a-abd336e3321b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:32.907782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dcbe2c-822f-48b4-bf3a-abd336e3321b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:33.013047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:33.057652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ee323-578d-4b45-954d-f60666de5197 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:33.058401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee323-578d-4b45-954d-f60666de5197 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:33.058688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee323-578d-4b45-954d-f60666de5197 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:33.058960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ee323-578d-4b45-954d-f60666de5197 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:33.060609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-de4ee323-578d-4b45-954d-f60666de5197 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:33.165592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ee323-578d-4b45-954d-f60666de5197 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:33.171961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ee323-578d-4b45-954d-f60666de5197 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:33.198071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 680/1360] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:35.429688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb35d9-38a6-4642-b7ea-0e6be9c5542c None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:35.430566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb35d9-38a6-4642-b7ea-0e6be9c5542c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:35.431022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb35d9-38a6-4642-b7ea-0e6be9c5542c None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:35.432558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 681/1361] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:35.437962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4598-38ab-4380-b819-7acd6bbfc592 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:35.438811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4598-38ab-4380-b819-7acd6bbfc592 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:35.439259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a4598-38ab-4380-b819-7acd6bbfc592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:35.509563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-2b1a4598-38ab-4380-b819-7acd6bbfc592 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:35.511027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2b1a4598-38ab-4380-b819-7acd6bbfc592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:35.551823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:35.625808 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 681/1362] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:35.670976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb35d9-38a6-4642-b7ea-0e6be9c5542c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:35.680447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-20bb35d9-38a6-4642-b7ea-0e6be9c5542c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:35.747552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:35.831811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb35d9-38a6-4642-b7ea-0e6be9c5542c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:35.987073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7178c-8959-485d-8eeb-a25fd612fe33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:35.987811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7178c-8959-485d-8eeb-a25fd612fe33 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:35.988161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7178c-8959-485d-8eeb-a25fd612fe33 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:35.988501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7178c-8959-485d-8eeb-a25fd612fe33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:35.990862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4ba7178c-8959-485d-8eeb-a25fd612fe33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:36.017058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:36.086572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7178c-8959-485d-8eeb-a25fd612fe33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:36.088280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7178c-8959-485d-8eeb-a25fd612fe33 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:36.114735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 682/1363] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:38.552121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ed89-a71c-4f8d-812e-be46d4dc6e39 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:38.552686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ed89-a71c-4f8d-812e-be46d4dc6e39 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:38.552686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455ed89-a71c-4f8d-812e-be46d4dc6e39 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:38.558147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 682/1364] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:38 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:38.559721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195816-451e-4b98-8ddf-60f6f64e6be0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:38.560165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195816-451e-4b98-8ddf-60f6f64e6be0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:38.560248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83195816-451e-4b98-8ddf-60f6f64e6be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:38.629646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-83195816-451e-4b98-8ddf-60f6f64e6be0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:38.630877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-83195816-451e-4b98-8ddf-60f6f64e6be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:38.731232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:38.738115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 683/1365] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:16:38.780473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec799a-10c6-480e-9bcc-7af50ecfaccc None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:38.780762 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec799a-10c6-480e-9bcc-7af50ecfaccc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:38.781165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bec799a-10c6-480e-9bcc-7af50ecfaccc None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:38.782850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 683/1366] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 18:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:38.789069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b3f9-39ef-4755-a6d0-e838d2acf1ad None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:38.789499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b3f9-39ef-4755-a6d0-e838d2acf1ad None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:38.789793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e4b3f9-39ef-4755-a6d0-e838d2acf1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:38.872707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c5e4b3f9-39ef-4755-a6d0-e838d2acf1ad None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:38.874201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c5e4b3f9-39ef-4755-a6d0-e838d2acf1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:39.003970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 684/1367] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 18:16:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:39.012272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec799a-10c6-480e-9bcc-7af50ecfaccc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:39.013933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3bec799a-10c6-480e-9bcc-7af50ecfaccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:39.181307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bec799a-10c6-480e-9bcc-7af50ecfaccc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:39.204016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:39.304311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f22aac-cae8-41b2-bab0-60ba3f9113d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:39.304848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f22aac-cae8-41b2-bab0-60ba3f9113d7 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:39.305132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f22aac-cae8-41b2-bab0-60ba3f9113d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:39.305409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f22aac-cae8-41b2-bab0-60ba3f9113d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:39.307060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-42f22aac-cae8-41b2-bab0-60ba3f9113d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:39.402591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f22aac-cae8-41b2-bab0-60ba3f9113d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:39.404546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f22aac-cae8-41b2-bab0-60ba3f9113d7 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:39.435714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 684/1368] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:40.333806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd919598-c1a4-49e1-b051-d6f62b384f5b None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:40.334319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd919598-c1a4-49e1-b051-d6f62b384f5b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:40.334319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd919598-c1a4-49e1-b051-d6f62b384f5b None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:40.335818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 685/1369] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:40.340766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe4363-b1bc-4b64-9035-30d2f0b43092 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:40.341182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe4363-b1bc-4b64-9035-30d2f0b43092 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:40.341317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe4363-b1bc-4b64-9035-30d2f0b43092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:40.374909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:40.411852 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-76fe4363-b1bc-4b64-9035-30d2f0b43092 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:40.413049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-76fe4363-b1bc-4b64-9035-30d2f0b43092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:40.517557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 685/1370] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:40.864688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6359-8777-45f9-83a0-5e2b2b423766 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:40.864688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6359-8777-45f9-83a0-5e2b2b423766 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:40.864688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0f6359-8777-45f9-83a0-5e2b2b423766 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:40.864688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 686/1371] 10.222.0.67 () {54 vars in 964 bytes} [Wed Jul 27 18:16:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:40.869580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ff823-67b3-4308-947c-186cab621479 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:40.869918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ff823-67b3-4308-947c-186cab621479 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:40.870202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ff823-67b3-4308-947c-186cab621479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:40.951166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-053ff823-67b3-4308-947c-186cab621479 None None] MFA Rules not processed for user `0d75852e9db24464bd69c0c19b75ab39`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:40.952390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-053ff823-67b3-4308-947c-186cab621479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:41.002798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:41.041539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 686/1372] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Jul 27 18:16:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:41.049403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6359-8777-45f9-83a0-5e2b2b423766 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:41.051370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1b0f6359-8777-45f9-83a0-5e2b2b423766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:41.105805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:41.163951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0f6359-8777-45f9-83a0-5e2b2b423766 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:41.239445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dba7780-905e-47bb-93ba-02983a389066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:41.240061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7780-905e-47bb-93ba-02983a389066 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:41.240340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7780-905e-47bb-93ba-02983a389066 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:41.240610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7780-905e-47bb-93ba-02983a389066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:41.242306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8dba7780-905e-47bb-93ba-02983a389066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:41.359600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:41.363106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7780-905e-47bb-93ba-02983a389066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:41.365432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dba7780-905e-47bb-93ba-02983a389066 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:41.385152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 687/1373] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:41.749902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae126-71fe-4847-b230-6a35a8d53bea None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:41.750494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae126-71fe-4847-b230-6a35a8d53bea None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:41.750494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ae126-71fe-4847-b230-6a35a8d53bea None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:41.752014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 687/1374] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:41.758076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c83222-1f53-4444-a8c7-63a085fe64b6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:41.758435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c83222-1f53-4444-a8c7-63a085fe64b6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:41.758794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c83222-1f53-4444-a8c7-63a085fe64b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:41.828012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e8c83222-1f53-4444-a8c7-63a085fe64b6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:41.829356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e8c83222-1f53-4444-a8c7-63a085fe64b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:41.925352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 688/1375] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:41.969187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae126-71fe-4847-b230-6a35a8d53bea None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:41.970725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-237ae126-71fe-4847-b230-6a35a8d53bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:42.120642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ae126-71fe-4847-b230-6a35a8d53bea None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:42.171811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:42.233715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc901cf-870b-4d41-960c-d988976d5262 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:42.234360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc901cf-870b-4d41-960c-d988976d5262 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:42.234642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc901cf-870b-4d41-960c-d988976d5262 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:42.234916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc901cf-870b-4d41-960c-d988976d5262 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:42.236535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4fc901cf-870b-4d41-960c-d988976d5262 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:42.327687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc901cf-870b-4d41-960c-d988976d5262 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:42.329272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc901cf-870b-4d41-960c-d988976d5262 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:42.346706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 688/1376] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:44.506796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328dd5-9e70-439a-b8e4-efe594782467 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:44.507302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328dd5-9e70-439a-b8e4-efe594782467 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:44.507428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f328dd5-9e70-439a-b8e4-efe594782467 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:44.508705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 689/1377] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:44.514358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bef6f-1e95-4e72-bb16-e24fa5559def None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:44.514761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bef6f-1e95-4e72-bb16-e24fa5559def None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:44.514860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6bef6f-1e95-4e72-bb16-e24fa5559def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:44.583174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ae6bef6f-1e95-4e72-bb16-e24fa5559def None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:44.584386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ae6bef6f-1e95-4e72-bb16-e24fa5559def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:44.591215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:44.682454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 689/1378] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:44.727681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328dd5-9e70-439a-b8e4-efe594782467 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:44.729239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8f328dd5-9e70-439a-b8e4-efe594782467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:44.789965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:44.884735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f328dd5-9e70-439a-b8e4-efe594782467 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:45.020595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064a71-3892-4859-8068-e0aae262a3e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:45.021219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064a71-3892-4859-8068-e0aae262a3e6 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:45.021499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064a71-3892-4859-8068-e0aae262a3e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:45.021826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064a71-3892-4859-8068-e0aae262a3e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:45.024093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d1064a71-3892-4859-8068-e0aae262a3e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:45.048346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:45.126400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064a71-3892-4859-8068-e0aae262a3e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:45.127987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1064a71-3892-4859-8068-e0aae262a3e6 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:45.147033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 690/1379] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:47.365360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19183-b2a2-43a6-a239-db4016ce2f6d None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:47.365972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19183-b2a2-43a6-a239-db4016ce2f6d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:47.365972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb19183-b2a2-43a6-a239-db4016ce2f6d None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:47.367436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 690/1380] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:47.372778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4a502-d4ba-40a8-9612-7b17066f1d9b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:47.373175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4a502-d4ba-40a8-9612-7b17066f1d9b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:47.373346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4a502-d4ba-40a8-9612-7b17066f1d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:47.440883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-1ca4a502-d4ba-40a8-9612-7b17066f1d9b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:47.442650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1ca4a502-d4ba-40a8-9612-7b17066f1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:47.541212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:47.547546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 691/1381] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:47.593250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19183-b2a2-43a6-a239-db4016ce2f6d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:47.594907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8eb19183-b2a2-43a6-a239-db4016ce2f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:47.751911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:47.766773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb19183-b2a2-43a6-a239-db4016ce2f6d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:47.899278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddccc9-29f1-491a-8f49-fdf8d67cef47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:47.899988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddccc9-29f1-491a-8f49-fdf8d67cef47 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:47.900338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddccc9-29f1-491a-8f49-fdf8d67cef47 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:47.900682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddccc9-29f1-491a-8f49-fdf8d67cef47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:47.902407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8eddccc9-29f1-491a-8f49-fdf8d67cef47 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:48.000205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddccc9-29f1-491a-8f49-fdf8d67cef47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:48.002407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddccc9-29f1-491a-8f49-fdf8d67cef47 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:48.015062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:48.025990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 691/1382] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:50.200025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbe88e-1ee7-4d81-8ce9-688b89996bdd None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:50.200555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbe88e-1ee7-4d81-8ce9-688b89996bdd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:50.200555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbe88e-1ee7-4d81-8ce9-688b89996bdd None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:50.202097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 692/1383] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:50.207408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30b36-22cc-4cf1-8753-8a219d9a7998 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:50.207849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30b36-22cc-4cf1-8753-8a219d9a7998 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:50.207982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c30b36-22cc-4cf1-8753-8a219d9a7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:50.276872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-56c30b36-22cc-4cf1-8753-8a219d9a7998 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:50.278393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-56c30b36-22cc-4cf1-8753-8a219d9a7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:50.381240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 692/1384] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:50.424620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbe88e-1ee7-4d81-8ce9-688b89996bdd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:50.426380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-afcbe88e-1ee7-4d81-8ce9-688b89996bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:50.578228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbe88e-1ee7-4d81-8ce9-688b89996bdd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:50.646848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:50.694917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a37e8-ad95-4a01-bccc-ffba4fdf2b33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:50.695543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a37e8-ad95-4a01-bccc-ffba4fdf2b33 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:50.695822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a37e8-ad95-4a01-bccc-ffba4fdf2b33 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:50.696141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a37e8-ad95-4a01-bccc-ffba4fdf2b33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:50.697775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-783a37e8-ad95-4a01-bccc-ffba4fdf2b33 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:50.793969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a37e8-ad95-4a01-bccc-ffba4fdf2b33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:50.796120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a37e8-ad95-4a01-bccc-ffba4fdf2b33 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:50.818890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 693/1385] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:53.043386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaa995-5928-4f7d-8212-253bbb545930 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:53.044063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaa995-5928-4f7d-8212-253bbb545930 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:53.044063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebaa995-5928-4f7d-8212-253bbb545930 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:53.045337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 693/1386] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:16:53.051476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d6ac-a15f-410d-bd59-7316a900502f None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:53.052009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d6ac-a15f-410d-bd59-7316a900502f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:53.052009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf56d6ac-a15f-410d-bd59-7316a900502f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:53.123134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bf56d6ac-a15f-410d-bd59-7316a900502f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:53.124665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bf56d6ac-a15f-410d-bd59-7316a900502f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:53.164614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:53.241779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 694/1387] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:16:53.300199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaa995-5928-4f7d-8212-253bbb545930 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:53.302898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-eebaa995-5928-4f7d-8212-253bbb545930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:53.392233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:53.464615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebaa995-5928-4f7d-8212-253bbb545930 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:53.586380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356436e8-f55e-47fa-9024-e54b9dcd9921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:53.587147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356436e8-f55e-47fa-9024-e54b9dcd9921 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:53.587493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356436e8-f55e-47fa-9024-e54b9dcd9921 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:53.587839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356436e8-f55e-47fa-9024-e54b9dcd9921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:53.589941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-356436e8-f55e-47fa-9024-e54b9dcd9921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:53.637899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:53.701986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356436e8-f55e-47fa-9024-e54b9dcd9921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:53.703999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356436e8-f55e-47fa-9024-e54b9dcd9921 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:53.726090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 694/1388] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:55.893795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb48740-3e9d-4f82-a938-b62eef42c518 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:55.894389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb48740-3e9d-4f82-a938-b62eef42c518 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:55.894389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb48740-3e9d-4f82-a938-b62eef42c518 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:55.895775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 695/1389] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:55.901056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1aa84-dd1a-4e03-92d9-fafb82d2af41 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:55.901440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1aa84-dd1a-4e03-92d9-fafb82d2af41 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:55.901617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1aa84-dd1a-4e03-92d9-fafb82d2af41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:55.970357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0bc1aa84-dd1a-4e03-92d9-fafb82d2af41 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:55.971566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0bc1aa84-dd1a-4e03-92d9-fafb82d2af41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:56.069361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 695/1390] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:56.112385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb48740-3e9d-4f82-a938-b62eef42c518 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:56.114471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4eb48740-3e9d-4f82-a938-b62eef42c518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:56.260833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb48740-3e9d-4f82-a938-b62eef42c518 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:56.277131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:56.372719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f565022-257d-455f-a8d1-7b5c0a128d3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:56.373343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f565022-257d-455f-a8d1-7b5c0a128d3f service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:56.373626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f565022-257d-455f-a8d1-7b5c0a128d3f service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:56.373932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f565022-257d-455f-a8d1-7b5c0a128d3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:56.375540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5f565022-257d-455f-a8d1-7b5c0a128d3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:56.463064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f565022-257d-455f-a8d1-7b5c0a128d3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:56.464667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f565022-257d-455f-a8d1-7b5c0a128d3f service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:56.483221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 696/1391] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:56.696788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51304-3b7d-4e57-9ade-da34c02c1d76 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:56.697068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51304-3b7d-4e57-9ade-da34c02c1d76 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:56.697339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51304-3b7d-4e57-9ade-da34c02c1d76 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:56.698884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 696/1392] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:56.704770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661810-ff1a-4881-b9b7-27b09b4e07e5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:56.705057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661810-ff1a-4881-b9b7-27b09b4e07e5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:56.705331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9661810-ff1a-4881-b9b7-27b09b4e07e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:56.734862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:56.782062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a9661810-ff1a-4881-b9b7-27b09b4e07e5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:56.783510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a9661810-ff1a-4881-b9b7-27b09b4e07e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:56.883984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 697/1393] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:56.939333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86d037-39b8-484a-8c63-438a92de1cfe None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:56.939820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86d037-39b8-484a-8c63-438a92de1cfe None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:56.939922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86d037-39b8-484a-8c63-438a92de1cfe None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:56.941861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 697/1394] 10.222.0.67 () {54 vars in 966 bytes} [Wed Jul 27 18:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:56.947015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6b13-90e6-4da8-ac95-8937224c48d8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:56.947489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6b13-90e6-4da8-ac95-8937224c48d8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:56.947606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740f6b13-90e6-4da8-ac95-8937224c48d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:57.022785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-740f6b13-90e6-4da8-ac95-8937224c48d8 None None] MFA Rules not processed for user `9d4eba8e853c41bcbd92d6cab54efd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:57.023992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-740f6b13-90e6-4da8-ac95-8937224c48d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:57.065218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:57.102975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 698/1395] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Jul 27 18:16:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:16:57.111705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86d037-39b8-484a-8c63-438a92de1cfe None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:57.113723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8e86d037-39b8-484a-8c63-438a92de1cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:57.127186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:57.217505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86d037-39b8-484a-8c63-438a92de1cfe None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:57.291518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e278f4-13f2-4d83-9f8c-be86f8ca6b60 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:57.292137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e278f4-13f2-4d83-9f8c-be86f8ca6b60 service glance] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:57.292414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e278f4-13f2-4d83-9f8c-be86f8ca6b60 service glance] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:57.292684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e278f4-13f2-4d83-9f8c-be86f8ca6b60 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:57.294338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-42e278f4-13f2-4d83-9f8c-be86f8ca6b60 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:57.361676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:57.403325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e278f4-13f2-4d83-9f8c-be86f8ca6b60 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:57.404775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e278f4-13f2-4d83-9f8c-be86f8ca6b60 service glance] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:57.423815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 698/1396] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:16:58.279157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bea2-b982-4f7f-89d7-72d4106929b4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:58.279655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bea2-b982-4f7f-89d7-72d4106929b4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:58.279907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c5bea2-b982-4f7f-89d7-72d4106929b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:58.346979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-59c5bea2-b982-4f7f-89d7-72d4106929b4 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:58.348759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-59c5bea2-b982-4f7f-89d7-72d4106929b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:58.434546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 699/1397] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:16:58.481031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc505-b75a-4fd7-ba36-d992c3f3df3d None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:58.481536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc505-b75a-4fd7-ba36-d992c3f3df3d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:58.481629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4fc505-b75a-4fd7-ba36-d992c3f3df3d None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:58.483087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 699/1398] 10.222.0.67 () {54 vars in 943 bytes} [Wed Jul 27 18:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:16:58.489506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a9d5-2d3d-4d81-b984-b86876a4d756 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:58.489829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a9d5-2d3d-4d81-b984-b86876a4d756 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:58.490111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8169a9d5-2d3d-4d81-b984-b86876a4d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:58.567772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:58.575914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8169a9d5-2d3d-4d81-b984-b86876a4d756 None None] MFA Rules not processed for user `e70a3ed5aa5441fb9e8d4ed8f071bcc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:58.577166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8169a9d5-2d3d-4d81-b984-b86876a4d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:58.647507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8196d-05ea-48d8-93e7-79b0f370ebe7 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:58.647796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8196d-05ea-48d8-93e7-79b0f370ebe7 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:58.648077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e8196d-05ea-48d8-93e7-79b0f370ebe7 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:58.649802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 700/1399] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:16:58.654505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:58.654791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:58.655061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:58.687210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 700/1400] 10.222.0.67 () {58 vars in 1040 bytes} [Wed Jul 27 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:16:58.697182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a9d5-2d3d-4d81-b984-b86876a4d756 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:58.707399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8169a9d5-2d3d-4d81-b984-b86876a4d756 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:58.724377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:16:58.725589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:58.813877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5366d8-0bb0-48fa-94a9-b76fabda9596 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:58.814503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5366d8-0bb0-48fa-94a9-b76fabda9596 service swift] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:58.814784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5366d8-0bb0-48fa-94a9-b76fabda9596 service swift] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:58.815059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5366d8-0bb0-48fa-94a9-b76fabda9596 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:58.817234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ce5366d8-0bb0-48fa-94a9-b76fabda9596 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:58.820224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:58.823593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 701/1401] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:16:58.868940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:16:58.870505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:58.898325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:58.904871 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5366d8-0bb0-48fa-94a9-b76fabda9596 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:58.907320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5366d8-0bb0-48fa-94a9-b76fabda9596 service swift] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:58.914846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 701/1402] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:16:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 18:16:58.987042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83bbd-9bcf-4f2a-9a17-cb651659c682 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:16:59.099563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ed42a-8db3-476a-a69c-7253497e9a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:16:59.100283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ed42a-8db3-476a-a69c-7253497e9a34 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:16:59.100455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ed42a-8db3-476a-a69c-7253497e9a34 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:16:59.100776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ed42a-8db3-476a-a69c-7253497e9a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:16:59.102438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-443ed42a-8db3-476a-a69c-7253497e9a34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:16:59.122537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:16:59.198044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ed42a-8db3-476a-a69c-7253497e9a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:16:59.199209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ed42a-8db3-476a-a69c-7253497e9a34 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:16:59.223934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 702/1403] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:16:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:17:01.436840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446a5b-53ac-4624-99b7-881afedfaf41 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:01.437389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446a5b-53ac-4624-99b7-881afedfaf41 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:01.437389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e446a5b-53ac-4624-99b7-881afedfaf41 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:01.442858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 702/1404] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:01.444691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d432-b168-4db5-a6bc-de00341dedea None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:01.445175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d432-b168-4db5-a6bc-de00341dedea None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:01.445438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303d432-b168-4db5-a6bc-de00341dedea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:01.521460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6303d432-b168-4db5-a6bc-de00341dedea None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:01.522724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6303d432-b168-4db5-a6bc-de00341dedea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:01.635509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:01.649823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 703/1405] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:17:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:01.687525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e446a5b-53ac-4624-99b7-881afedfaf41 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:01.689017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3e446a5b-53ac-4624-99b7-881afedfaf41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:01.849345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:01.852095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e446a5b-53ac-4624-99b7-881afedfaf41 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:01.982842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054ce08-73cc-40d2-b47f-b271f4fefdc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:01.983471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ce08-73cc-40d2-b47f-b271f4fefdc8 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:01.983754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ce08-73cc-40d2-b47f-b271f4fefdc8 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:01.984031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054ce08-73cc-40d2-b47f-b271f4fefdc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:01.985650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7054ce08-73cc-40d2-b47f-b271f4fefdc8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:02.086473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ce08-73cc-40d2-b47f-b271f4fefdc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:02.088086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054ce08-73cc-40d2-b47f-b271f4fefdc8 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:02.107669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 703/1406] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:04.261220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d42a-9bf8-4ea5-a75b-cedb8aa96621 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:04.261652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d42a-9bf8-4ea5-a75b-cedb8aa96621 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:04.261789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3863d42a-9bf8-4ea5-a75b-cedb8aa96621 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:04.267068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 704/1407] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:17:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:04.268665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ec83e-ff18-4066-b8cd-e554b0af0c92 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:04.269541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ec83e-ff18-4066-b8cd-e554b0af0c92 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:04.270010 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ec83e-ff18-4066-b8cd-e554b0af0c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:04.274628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:04.349736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-499ec83e-ff18-4066-b8cd-e554b0af0c92 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:04.351343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-499ec83e-ff18-4066-b8cd-e554b0af0c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:04.461881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 704/1408] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:17:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:04.508423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d42a-9bf8-4ea5-a75b-cedb8aa96621 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:04.510163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3863d42a-9bf8-4ea5-a75b-cedb8aa96621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:04.679560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3863d42a-9bf8-4ea5-a75b-cedb8aa96621 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:04.760198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:04.812067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fb8937-4589-46be-9465-5f7d5be26746 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:04.812799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8937-4589-46be-9465-5f7d5be26746 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:04.813251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8937-4589-46be-9465-5f7d5be26746 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:04.813609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fb8937-4589-46be-9465-5f7d5be26746 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:04.817000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a4fb8937-4589-46be-9465-5f7d5be26746 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:04.916712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb8937-4589-46be-9465-5f7d5be26746 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:04.918382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fb8937-4589-46be-9465-5f7d5be26746 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:04.939327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 705/1409] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:14.487774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=64 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:14.936898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=64 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:22.326437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606349b1-5e7e-447e-b2ec-d7aefab6f480 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:22.327033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606349b1-5e7e-447e-b2ec-d7aefab6f480 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:22.327033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606349b1-5e7e-447e-b2ec-d7aefab6f480 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:22.328362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 705/1410] 10.222.0.67 () {54 vars in 918 bytes} [Wed Jul 27 18:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:22.334131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d7f9-567a-4726-b6a9-4c8ba5660fdf None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:22.334557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d7f9-567a-4726-b6a9-4c8ba5660fdf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:22.334670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f6d7f9-567a-4726-b6a9-4c8ba5660fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:22.412709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-54f6d7f9-567a-4726-b6a9-4c8ba5660fdf None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:22.414026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-54f6d7f9-567a-4726-b6a9-4c8ba5660fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:22.519859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 706/1411] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Jul 27 18:17:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:22.534331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84696c7-1f69-4154-b328-5d76bf1509bf None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:22.534612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84696c7-1f69-4154-b328-5d76bf1509bf None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:22.534881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84696c7-1f69-4154-b328-5d76bf1509bf None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:22.536228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 706/1412] 10.222.0.67 () {54 vars in 918 bytes} [Wed Jul 27 18:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:22.540865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3299-b2c2-48e0-a530-0142b1b00203 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:22.541178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3299-b2c2-48e0-a530-0142b1b00203 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:22.541456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e3299-b2c2-48e0-a530-0142b1b00203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:22.614605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:22.617601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d93e3299-b2c2-48e0-a530-0142b1b00203 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:22.618833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d93e3299-b2c2-48e0-a530-0142b1b00203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:22.732473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 707/1413] 10.222.0.67 () {58 vars in 1015 bytes} [Wed Jul 27 18:17:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:25.178613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62fb5-2790-4aac-b8ca-2b2b3bab0c43 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:25.179145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62fb5-2790-4aac-b8ca-2b2b3bab0c43 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:25.179145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e62fb5-2790-4aac-b8ca-2b2b3bab0c43 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:25.180573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 707/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:25.185844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b546b-76fc-4aff-9c27-ef1d0e442e36 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:25.186267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b546b-76fc-4aff-9c27-ef1d0e442e36 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:25.186397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b546b-76fc-4aff-9c27-ef1d0e442e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:25.256382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-827b546b-76fc-4aff-9c27-ef1d0e442e36 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:25.257593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-827b546b-76fc-4aff-9c27-ef1d0e442e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:25.310716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:25.352169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 708/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:25.395445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62fb5-2790-4aac-b8ca-2b2b3bab0c43 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:25.396972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-49e62fb5-2790-4aac-b8ca-2b2b3bab0c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:25.542409 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e62fb5-2790-4aac-b8ca-2b2b3bab0c43 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:25.614890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:25.653724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1daf70e-bbbc-4886-8dd3-fce0df09d548 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:25.654298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf70e-bbbc-4886-8dd3-fce0df09d548 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:25.654574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf70e-bbbc-4886-8dd3-fce0df09d548 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:25.654842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1daf70e-bbbc-4886-8dd3-fce0df09d548 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:25.656426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c1daf70e-bbbc-4886-8dd3-fce0df09d548 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:25.744042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daf70e-bbbc-4886-8dd3-fce0df09d548 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:25.745917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1daf70e-bbbc-4886-8dd3-fce0df09d548 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:25.763451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 708/1416] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:26.672985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a019ee6-b7d4-47e6-af17-f12273985114 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:26.677467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a019ee6-b7d4-47e6-af17-f12273985114 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:26.677467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a019ee6-b7d4-47e6-af17-f12273985114 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:26.677467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 709/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:26.680003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98143-cbd3-47c3-9cff-ba76ee8d2f14 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:26.680402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98143-cbd3-47c3-9cff-ba76ee8d2f14 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:26.680543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f98143-cbd3-47c3-9cff-ba76ee8d2f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:26.754819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-60f98143-cbd3-47c3-9cff-ba76ee8d2f14 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:26.755998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-60f98143-cbd3-47c3-9cff-ba76ee8d2f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:26.781952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:26.851019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 709/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:27.008258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a019ee6-b7d4-47e6-af17-f12273985114 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:27.009828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9a019ee6-b7d4-47e6-af17-f12273985114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:27.154564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a019ee6-b7d4-47e6-af17-f12273985114 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:27.195217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:27.389410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb24101-15cf-44d2-9ddc-3aef8aa5cba9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:27.389953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb24101-15cf-44d2-9ddc-3aef8aa5cba9 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:27.390236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb24101-15cf-44d2-9ddc-3aef8aa5cba9 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:27.390509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb24101-15cf-44d2-9ddc-3aef8aa5cba9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:27.392158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0fb24101-15cf-44d2-9ddc-3aef8aa5cba9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:27.480245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb24101-15cf-44d2-9ddc-3aef8aa5cba9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:27.481936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb24101-15cf-44d2-9ddc-3aef8aa5cba9 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:27.500328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 710/1419] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:28.394685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53f7a9-b378-40a7-9f73-096c8c5e31d6 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:28.395198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53f7a9-b378-40a7-9f73-096c8c5e31d6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:28.395198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53f7a9-b378-40a7-9f73-096c8c5e31d6 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:28.396561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 710/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:28.401660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0383-99b7-4017-88cc-e6d71e2e1bb8 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:28.402129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0383-99b7-4017-88cc-e6d71e2e1bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:28.402236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3a0383-99b7-4017-88cc-e6d71e2e1bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:28.456748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:28.478286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ba3a0383-99b7-4017-88cc-e6d71e2e1bb8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:28.479475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ba3a0383-99b7-4017-88cc-e6d71e2e1bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:28.575189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 711/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:17:28.727166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53f7a9-b378-40a7-9f73-096c8c5e31d6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:28.728695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8a53f7a9-b378-40a7-9f73-096c8c5e31d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:28.872037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53f7a9-b378-40a7-9f73-096c8c5e31d6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:28.884330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:28.980544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0226fb5-5d99-4528-bf8c-92e721439bda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:28.981079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0226fb5-5d99-4528-bf8c-92e721439bda service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:28.981352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0226fb5-5d99-4528-bf8c-92e721439bda service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:28.981623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0226fb5-5d99-4528-bf8c-92e721439bda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:28.983229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c0226fb5-5d99-4528-bf8c-92e721439bda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:29.073030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0226fb5-5d99-4528-bf8c-92e721439bda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:29.074693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0226fb5-5d99-4528-bf8c-92e721439bda service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:29.092242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 711/1422] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:29.952820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf00cd-a779-416a-925e-b759e81156d9 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:29.953381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf00cd-a779-416a-925e-b759e81156d9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:29.953496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf00cd-a779-416a-925e-b759e81156d9 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:29.955523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 712/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:29.960401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eedb-2871-4cb0-a1ac-957a228d5c39 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:29.960835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eedb-2871-4cb0-a1ac-957a228d5c39 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:29.960944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7eedb-2871-4cb0-a1ac-957a228d5c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:29.980609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:30.037364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e9c7eedb-2871-4cb0-a1ac-957a228d5c39 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:30.038587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e9c7eedb-2871-4cb0-a1ac-957a228d5c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:30.135552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 712/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:30.285927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf00cd-a779-416a-925e-b759e81156d9 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:30.287481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-aaaf00cd-a779-416a-925e-b759e81156d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:30.396911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:30.433092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf00cd-a779-416a-925e-b759e81156d9 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:30.545630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d5cdba-c6ad-4362-827a-660b0e8eb945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:30.546194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cdba-c6ad-4362-827a-660b0e8eb945 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:30.546468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cdba-c6ad-4362-827a-660b0e8eb945 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:30.546734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d5cdba-c6ad-4362-827a-660b0e8eb945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:30.548823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-80d5cdba-c6ad-4362-827a-660b0e8eb945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:30.623296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:30.636711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5cdba-c6ad-4362-827a-660b0e8eb945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:30.638335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d5cdba-c6ad-4362-827a-660b0e8eb945 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:30.656677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 713/1425] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:31.518019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3fd8-683f-4162-bc41-2cb990eecf3f None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:31.518553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3fd8-683f-4162-bc41-2cb990eecf3f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:31.518553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc3fd8-683f-4162-bc41-2cb990eecf3f None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:31.519912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 713/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:31.524922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da549f7-564a-49c5-a1d7-32331e52de03 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:31.525376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da549f7-564a-49c5-a1d7-32331e52de03 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:31.525474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da549f7-564a-49c5-a1d7-32331e52de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:31.600773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9da549f7-564a-49c5-a1d7-32331e52de03 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:31.602160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9da549f7-564a-49c5-a1d7-32331e52de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:31.698852 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 714/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:31.849841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3fd8-683f-4162-bc41-2cb990eecf3f None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:31.851326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bedc3fd8-683f-4162-bc41-2cb990eecf3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:31.932283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:31.993085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc3fd8-683f-4162-bc41-2cb990eecf3f None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:32.104895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f248120a-3e1c-4d9a-9ab1-18c019a8463c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:32.105455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248120a-3e1c-4d9a-9ab1-18c019a8463c service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:32.105740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248120a-3e1c-4d9a-9ab1-18c019a8463c service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:32.106030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f248120a-3e1c-4d9a-9ab1-18c019a8463c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:32.107630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f248120a-3e1c-4d9a-9ab1-18c019a8463c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:32.156113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:32.196684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248120a-3e1c-4d9a-9ab1-18c019a8463c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:32.198303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f248120a-3e1c-4d9a-9ab1-18c019a8463c service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:32.216439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 714/1428] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:33.091379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3617d-b16c-4def-ad45-e02e2554e583 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:33.091942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3617d-b16c-4def-ad45-e02e2554e583 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:33.091942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3617d-b16c-4def-ad45-e02e2554e583 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:33.093306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 715/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:33.098798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92f5a8-729b-48b9-a732-3cb81ccd53fd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:33.099212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92f5a8-729b-48b9-a732-3cb81ccd53fd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:33.099362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df92f5a8-729b-48b9-a732-3cb81ccd53fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:33.174738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-df92f5a8-729b-48b9-a732-3cb81ccd53fd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:33.175822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-df92f5a8-729b-48b9-a732-3cb81ccd53fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:33.270828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 715/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:33.420637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3617d-b16c-4def-ad45-e02e2554e583 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:33.422173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3bd3617d-b16c-4def-ad45-e02e2554e583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:33.470874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:33.567516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3617d-b16c-4def-ad45-e02e2554e583 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:33.681263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e04c7e-1210-44f2-adba-18b17a4f9f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:33.681910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04c7e-1210-44f2-adba-18b17a4f9f3f service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:33.682192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04c7e-1210-44f2-adba-18b17a4f9f3f service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:33.682459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e04c7e-1210-44f2-adba-18b17a4f9f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:33.684046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-01e04c7e-1210-44f2-adba-18b17a4f9f3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:33.691318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:33.773264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e04c7e-1210-44f2-adba-18b17a4f9f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:33.774894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e04c7e-1210-44f2-adba-18b17a4f9f3f service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:33.792612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 716/1431] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:34.677409 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c89d4e-44ba-427e-b61b-3e24ad7e1c21 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:34.677997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c89d4e-44ba-427e-b61b-3e24ad7e1c21 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:34.677997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c89d4e-44ba-427e-b61b-3e24ad7e1c21 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:34.679441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 716/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:34.684350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e8550-a8bf-41ff-93d8-d031b0065ccd None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:34.684782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e8550-a8bf-41ff-93d8-d031b0065ccd None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:34.684888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e8550-a8bf-41ff-93d8-d031b0065ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:34.760594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-178e8550-a8bf-41ff-93d8-d031b0065ccd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:34.761806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-178e8550-a8bf-41ff-93d8-d031b0065ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:34.828629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:34.856590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 717/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:35.008941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c89d4e-44ba-427e-b61b-3e24ad7e1c21 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:35.010486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-21c89d4e-44ba-427e-b61b-3e24ad7e1c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:35.027944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:35.158025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c89d4e-44ba-427e-b61b-3e24ad7e1c21 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:35.245985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:35.272381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d7cbc-3bfc-44c4-9eca-592350e7aab0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:35.273501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7cbc-3bfc-44c4-9eca-592350e7aab0 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:35.273501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7cbc-3bfc-44c4-9eca-592350e7aab0 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:35.273681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d7cbc-3bfc-44c4-9eca-592350e7aab0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:35.275266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-598d7cbc-3bfc-44c4-9eca-592350e7aab0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:35.364374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d7cbc-3bfc-44c4-9eca-592350e7aab0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:35.365929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d7cbc-3bfc-44c4-9eca-592350e7aab0 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:35.384212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 717/1434] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:36.272093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8e7a-da16-4b60-8d11-9914ddda1e9b None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:36.272648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8e7a-da16-4b60-8d11-9914ddda1e9b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:36.272648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f8e7a-da16-4b60-8d11-9914ddda1e9b None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:36.274024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 718/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:36.278972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7ef56-9bc1-47d3-9b50-1d118135ea41 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:36.279418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7ef56-9bc1-47d3-9b50-1d118135ea41 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:36.279523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7ef56-9bc1-47d3-9b50-1d118135ea41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:36.354941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-5fe7ef56-9bc1-47d3-9b50-1d118135ea41 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:36.356054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5fe7ef56-9bc1-47d3-9b50-1d118135ea41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:36.396601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:36.452156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 718/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:36.603369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f8e7a-da16-4b60-8d11-9914ddda1e9b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:36.604874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e90f8e7a-da16-4b60-8d11-9914ddda1e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:36.752222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f8e7a-da16-4b60-8d11-9914ddda1e9b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:36.807274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:36.865517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c946424-fea3-4400-b07a-35ea236867ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:36.866192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c946424-fea3-4400-b07a-35ea236867ac service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:36.866495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c946424-fea3-4400-b07a-35ea236867ac service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:36.866765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c946424-fea3-4400-b07a-35ea236867ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:36.868367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9c946424-fea3-4400-b07a-35ea236867ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:36.955593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c946424-fea3-4400-b07a-35ea236867ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:36.957181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c946424-fea3-4400-b07a-35ea236867ac service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:36.976141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 719/1437] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:37.855967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ee26-454b-44a3-9435-4e4e4c547c98 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:37.856500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ee26-454b-44a3-9435-4e4e4c547c98 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:37.856500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265ee26-454b-44a3-9435-4e4e4c547c98 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:37.857818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 719/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:37.863292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2ac19-84cc-475c-9ff7-15d12ba5aa54 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:37.863741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2ac19-84cc-475c-9ff7-15d12ba5aa54 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:37.863856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2ac19-84cc-475c-9ff7-15d12ba5aa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:37.938360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6ae2ac19-84cc-475c-9ff7-15d12ba5aa54 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:37.939574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6ae2ac19-84cc-475c-9ff7-15d12ba5aa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:37.942151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:38.038148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 720/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:38.188104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ee26-454b-44a3-9435-4e4e4c547c98 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:38.189662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2265ee26-454b-44a3-9435-4e4e4c547c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:38.332720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265ee26-454b-44a3-9435-4e4e4c547c98 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:38.359056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:38.445460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01fb4c-f175-4535-9f61-d46e0a6ff86b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:38.446369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fb4c-f175-4535-9f61-d46e0a6ff86b service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:38.446656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fb4c-f175-4535-9f61-d46e0a6ff86b service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:38.446923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01fb4c-f175-4535-9f61-d46e0a6ff86b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:38.448528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5f01fb4c-f175-4535-9f61-d46e0a6ff86b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:38.541661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01fb4c-f175-4535-9f61-d46e0a6ff86b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:38.543310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01fb4c-f175-4535-9f61-d46e0a6ff86b service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:38.561628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 720/1440] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:40.462528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6d68-b19c-42e2-affe-932f693678a5 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:40.463083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6d68-b19c-42e2-affe-932f693678a5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:40.463083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f6d68-b19c-42e2-affe-932f693678a5 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:40.464383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 721/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:40.469577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19242-4b52-4dbd-ac2d-bf4303580d4a None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:40.470047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19242-4b52-4dbd-ac2d-bf4303580d4a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:40.470153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed19242-4b52-4dbd-ac2d-bf4303580d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:40.511091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:40.535764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bed19242-4b52-4dbd-ac2d-bf4303580d4a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:40.536956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bed19242-4b52-4dbd-ac2d-bf4303580d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:40.634364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 721/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:40.672919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f6d68-b19c-42e2-affe-932f693678a5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:40.674560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ad3f6d68-b19c-42e2-affe-932f693678a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:40.780003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3f6d68-b19c-42e2-affe-932f693678a5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:40.812533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:40.855229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd6cd8-f466-4f45-bbe5-765dcf029a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:40.855829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6cd8-f466-4f45-bbe5-765dcf029a72 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:40.856143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6cd8-f466-4f45-bbe5-765dcf029a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:40.856410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd6cd8-f466-4f45-bbe5-765dcf029a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:40.858019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-30dd6cd8-f466-4f45-bbe5-765dcf029a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:40.972928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd6cd8-f466-4f45-bbe5-765dcf029a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:40.974429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd6cd8-f466-4f45-bbe5-765dcf029a72 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:40.993073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 722/1443] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:43.112240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f4c50-34f5-4331-96d0-1ba88c552417 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:43.112763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f4c50-34f5-4331-96d0-1ba88c552417 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:43.112763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f4c50-34f5-4331-96d0-1ba88c552417 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:43.114373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 722/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:43.119749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ede89-5a30-42d9-9ca2-3b512d873780 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:43.120136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ede89-5a30-42d9-9ca2-3b512d873780 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:43.120295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ede89-5a30-42d9-9ca2-3b512d873780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:43.184831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-be4ede89-5a30-42d9-9ca2-3b512d873780 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:43.186051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-be4ede89-5a30-42d9-9ca2-3b512d873780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:43.199329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:43.282628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 723/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:43.320768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f4c50-34f5-4331-96d0-1ba88c552417 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:43.322329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-463f4c50-34f5-4331-96d0-1ba88c552417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:43.422190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f4c50-34f5-4331-96d0-1ba88c552417 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:43.434453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:43.496096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecd3aad-af9e-400c-892b-3bf6c6700036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:43.496716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3aad-af9e-400c-892b-3bf6c6700036 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:43.496998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3aad-af9e-400c-892b-3bf6c6700036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:43.497273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecd3aad-af9e-400c-892b-3bf6c6700036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:43.498920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2ecd3aad-af9e-400c-892b-3bf6c6700036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:43.604910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3aad-af9e-400c-892b-3bf6c6700036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:43.606379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecd3aad-af9e-400c-892b-3bf6c6700036 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:43.624808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 723/1446] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:45.988457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be53e-38dc-47dd-b33e-356dad71cef1 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:45.989017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be53e-38dc-47dd-b33e-356dad71cef1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:45.989017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321be53e-38dc-47dd-b33e-356dad71cef1 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:45.990421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 724/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:45.995971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5feba-3652-4f85-b4b0-15a4b500cea2 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:45.996383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5feba-3652-4f85-b4b0-15a4b500cea2 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:45.996522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a5feba-3652-4f85-b4b0-15a4b500cea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:46.047119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:46.065986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a8a5feba-3652-4f85-b4b0-15a4b500cea2 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:46.067195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a8a5feba-3652-4f85-b4b0-15a4b500cea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:46.164132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 724/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:46.203368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be53e-38dc-47dd-b33e-356dad71cef1 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:46.204900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-321be53e-38dc-47dd-b33e-356dad71cef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:46.308084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321be53e-38dc-47dd-b33e-356dad71cef1 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:46.347802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:46.381903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5dd4bd-7a0e-4d05-b505-a2b216d10a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:46.382515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd4bd-7a0e-4d05-b505-a2b216d10a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:46.382799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd4bd-7a0e-4d05-b505-a2b216d10a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:46.383069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5dd4bd-7a0e-4d05-b505-a2b216d10a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:46.384682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cb5dd4bd-7a0e-4d05-b505-a2b216d10a94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:46.492418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd4bd-7a0e-4d05-b505-a2b216d10a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:46.493874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5dd4bd-7a0e-4d05-b505-a2b216d10a94 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:46.512239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 725/1449] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:48.667894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2bcc4-aacd-4ef1-a4ca-5cecee487880 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:48.668514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2bcc4-aacd-4ef1-a4ca-5cecee487880 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:48.668514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e2bcc4-aacd-4ef1-a4ca-5cecee487880 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:48.669819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 725/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:48.675088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bd45-b198-42e6-9bf5-784ce784717f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:48.679740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bd45-b198-42e6-9bf5-784ce784717f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:48.679740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8600bd45-b198-42e6-9bf5-784ce784717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:48.741875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8600bd45-b198-42e6-9bf5-784ce784717f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:48.743086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8600bd45-b198-42e6-9bf5-784ce784717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:48.764899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:48.840756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 726/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:17:48.879503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2bcc4-aacd-4ef1-a4ca-5cecee487880 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:48.881042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b2e2bcc4-aacd-4ef1-a4ca-5cecee487880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:48.982421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e2bcc4-aacd-4ef1-a4ca-5cecee487880 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:49.003493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:49.057232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d3843-53c7-4153-b5b0-566b0c4ead32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:49.057905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3843-53c7-4153-b5b0-566b0c4ead32 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:49.058189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3843-53c7-4153-b5b0-566b0c4ead32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:49.058463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d3843-53c7-4153-b5b0-566b0c4ead32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:49.060060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4a4d3843-53c7-4153-b5b0-566b0c4ead32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:49.166733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d3843-53c7-4153-b5b0-566b0c4ead32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:49.168163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4d3843-53c7-4153-b5b0-566b0c4ead32 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:49.186557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 726/1452] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:51.240241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8be29-9b5f-487e-9290-5e7f9f47f4ce None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:51.240791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8be29-9b5f-487e-9290-5e7f9f47f4ce None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:51.240900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea8be29-9b5f-487e-9290-5e7f9f47f4ce None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:51.242291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 727/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:51.247755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef2cfc-6f68-46a4-b3de-67849f9068aa None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:51.248192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef2cfc-6f68-46a4-b3de-67849f9068aa None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:51.248310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef2cfc-6f68-46a4-b3de-67849f9068aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:51.310906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:51.316414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-10ef2cfc-6f68-46a4-b3de-67849f9068aa None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:51.317636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-10ef2cfc-6f68-46a4-b3de-67849f9068aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:51.413414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 727/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:51.451619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8be29-9b5f-487e-9290-5e7f9f47f4ce None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:51.453186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9ea8be29-9b5f-487e-9290-5e7f9f47f4ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:51.555645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea8be29-9b5f-487e-9290-5e7f9f47f4ce None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:51.604726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:51.630047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8331dbe7-eb3f-403d-9c58-29f3aecb68e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:51.630658 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331dbe7-eb3f-403d-9c58-29f3aecb68e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:51.630933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331dbe7-eb3f-403d-9c58-29f3aecb68e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:51.631198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8331dbe7-eb3f-403d-9c58-29f3aecb68e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:51.632802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8331dbe7-eb3f-403d-9c58-29f3aecb68e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:51.739298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331dbe7-eb3f-403d-9c58-29f3aecb68e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:51.740718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8331dbe7-eb3f-403d-9c58-29f3aecb68e5 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:51.759885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 728/1455] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:53.864465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfd721-1c9d-4006-b451-e4c2ff0e2edf None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:53.865066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfd721-1c9d-4006-b451-e4c2ff0e2edf None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:53.865066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfd721-1c9d-4006-b451-e4c2ff0e2edf None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:53.866463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 728/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:53.872244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbfa75-b630-48d5-a3c4-31ec456d3582 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:53.872645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbfa75-b630-48d5-a3c4-31ec456d3582 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:53.872800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adbfa75-b630-48d5-a3c4-31ec456d3582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:53.939525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9adbfa75-b630-48d5-a3c4-31ec456d3582 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:53.940730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9adbfa75-b630-48d5-a3c4-31ec456d3582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:53.970025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:54.036551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 729/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:54.074336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfd721-1c9d-4006-b451-e4c2ff0e2edf None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:54.075911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7ebfd721-1c9d-4006-b451-e4c2ff0e2edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:54.178872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfd721-1c9d-4006-b451-e4c2ff0e2edf None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:54.207233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:54.253634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff4c33-d049-450a-b73b-057f1a9b4b04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:54.254295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff4c33-d049-450a-b73b-057f1a9b4b04 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:54.254575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff4c33-d049-450a-b73b-057f1a9b4b04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:54.254850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff4c33-d049-450a-b73b-057f1a9b4b04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:54.256462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-54ff4c33-d049-450a-b73b-057f1a9b4b04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:54.365677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff4c33-d049-450a-b73b-057f1a9b4b04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:54.367208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff4c33-d049-450a-b73b-057f1a9b4b04 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:54.386632 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 729/1458] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:56.443875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ddd4-9c13-4637-9885-d6096e7b147e None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:56.444403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ddd4-9c13-4637-9885-d6096e7b147e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:56.444403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c7ddd4-9c13-4637-9885-d6096e7b147e None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:56.445724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 730/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:56.450868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a83a-f242-44e4-b910-9d835316b191 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:56.451272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a83a-f242-44e4-b910-9d835316b191 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:56.451372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671a83a-f242-44e4-b910-9d835316b191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:56.515582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e671a83a-f242-44e4-b910-9d835316b191 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:56.517290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e671a83a-f242-44e4-b910-9d835316b191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:56.525334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:56.613025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 730/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:56.650495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7ddd4-9c13-4637-9885-d6096e7b147e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:56.652066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-70c7ddd4-9c13-4637-9885-d6096e7b147e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:56.755170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c7ddd4-9c13-4637-9885-d6096e7b147e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:56.810832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:56.829090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5229b9-13e9-4861-bd40-399bece40ca1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:56.830245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5229b9-13e9-4861-bd40-399bece40ca1 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:56.830632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5229b9-13e9-4861-bd40-399bece40ca1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:56.830909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5229b9-13e9-4861-bd40-399bece40ca1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:56.832520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7b5229b9-13e9-4861-bd40-399bece40ca1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:56.940544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5229b9-13e9-4861-bd40-399bece40ca1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:56.942001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5229b9-13e9-4861-bd40-399bece40ca1 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:56.960700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 731/1461] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:17:59.011580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966e74-2773-4792-bb7a-abae04c5e00a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:59.012100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966e74-2773-4792-bb7a-abae04c5e00a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:59.012217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966e74-2773-4792-bb7a-abae04c5e00a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:59.013518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 731/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:17:59.018789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843e62-df66-4425-8929-5b967b5b8e93 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:59.019220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843e62-df66-4425-8929-5b967b5b8e93 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:59.019376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d843e62-df66-4425-8929-5b967b5b8e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:59.085233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0d843e62-df66-4425-8929-5b967b5b8e93 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:17:59.086457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0d843e62-df66-4425-8929-5b967b5b8e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:59.125705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:59.185509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 732/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:17:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:17:59.223648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966e74-2773-4792-bb7a-abae04c5e00a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:17:59.225178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f8966e74-2773-4792-bb7a-abae04c5e00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:59.325512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966e74-2773-4792-bb7a-abae04c5e00a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:17:59.361945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:17:59.395631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be34102-8a9d-4027-bb4b-ea039af76f68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:17:59.396430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be34102-8a9d-4027-bb4b-ea039af76f68 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:17:59.396786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be34102-8a9d-4027-bb4b-ea039af76f68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:17:59.396786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be34102-8a9d-4027-bb4b-ea039af76f68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:17:59.399247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6be34102-8a9d-4027-bb4b-ea039af76f68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:17:59.509268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be34102-8a9d-4027-bb4b-ea039af76f68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:17:59.510753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be34102-8a9d-4027-bb4b-ea039af76f68 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:17:59.529902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 732/1464] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:17:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:01.548699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eee74-8040-42e5-982e-785fbfc6155f None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:01.549257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eee74-8040-42e5-982e-785fbfc6155f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:01.549257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72eee74-8040-42e5-982e-785fbfc6155f None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:01.550673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 733/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:18:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:01.555952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424a1ef-1204-424b-a979-8a378d4c0e2b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:01.556371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424a1ef-1204-424b-a979-8a378d4c0e2b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:01.556505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3424a1ef-1204-424b-a979-8a378d4c0e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:01.620888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-3424a1ef-1204-424b-a979-8a378d4c0e2b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:01.622104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3424a1ef-1204-424b-a979-8a378d4c0e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:01.639476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:01.723227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 733/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:01.760759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eee74-8040-42e5-982e-785fbfc6155f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:01.762300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f72eee74-8040-42e5-982e-785fbfc6155f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:01.867392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72eee74-8040-42e5-982e-785fbfc6155f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:01.933047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:01.940432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63304362-3f41-473e-9980-b9f05e69cdb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:01.941048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304362-3f41-473e-9980-b9f05e69cdb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:01.941434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304362-3f41-473e-9980-b9f05e69cdb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:01.941709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63304362-3f41-473e-9980-b9f05e69cdb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:01.943376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-63304362-3f41-473e-9980-b9f05e69cdb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:02.050317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304362-3f41-473e-9980-b9f05e69cdb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:02.051754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63304362-3f41-473e-9980-b9f05e69cdb6 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:02.070024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 734/1467] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:04.062005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd4fe-9e86-4c33-a263-50c536c66947 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:04.062573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd4fe-9e86-4c33-a263-50c536c66947 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:04.062573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62bd4fe-9e86-4c33-a263-50c536c66947 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:04.063975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 734/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:18:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:04.069081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa03a-46f0-4a3d-9295-9f9d56b6de8f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:04.076786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa03a-46f0-4a3d-9295-9f9d56b6de8f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:04.076786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582fa03a-46f0-4a3d-9295-9f9d56b6de8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:04.136708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-582fa03a-46f0-4a3d-9295-9f9d56b6de8f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:04.137965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-582fa03a-46f0-4a3d-9295-9f9d56b6de8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:04.186939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:04.235320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 735/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:04.273020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd4fe-9e86-4c33-a263-50c536c66947 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:04.274617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f62bd4fe-9e86-4c33-a263-50c536c66947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:04.379207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62bd4fe-9e86-4c33-a263-50c536c66947 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:04.426425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:04.454642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e88f6d-b9af-47d0-9ce0-f80aa00108de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:04.455294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88f6d-b9af-47d0-9ce0-f80aa00108de service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:04.455575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88f6d-b9af-47d0-9ce0-f80aa00108de service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:04.455849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e88f6d-b9af-47d0-9ce0-f80aa00108de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:04.457519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a3e88f6d-b9af-47d0-9ce0-f80aa00108de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:04.564013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e88f6d-b9af-47d0-9ce0-f80aa00108de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:04.565873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e88f6d-b9af-47d0-9ce0-f80aa00108de service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:04.585037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 735/1470] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:14.233427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=22 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:14.582724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=66 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:24.081137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b37bc-2eb3-4703-ad81-b531abe5c200 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:24.081752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b37bc-2eb3-4703-ad81-b531abe5c200 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:24.081752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18b37bc-2eb3-4703-ad81-b531abe5c200 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:24.083119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 736/1471] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:24.088308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3a2e-e9b1-4167-8f71-f3526e37b579 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:24.088743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3a2e-e9b1-4167-8f71-f3526e37b579 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:24.088885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487c3a2e-e9b1-4167-8f71-f3526e37b579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:24.158408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-487c3a2e-e9b1-4167-8f71-f3526e37b579 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:24.159648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-487c3a2e-e9b1-4167-8f71-f3526e37b579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:24.255954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 736/1472] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:24.340147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50caf87-6135-4e00-81ca-cbbdf6567959 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:24.340428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50caf87-6135-4e00-81ca-cbbdf6567959 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:24.340696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50caf87-6135-4e00-81ca-cbbdf6567959 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:24.342259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 737/1473] 10.222.0.67 () {54 vars in 966 bytes} [Wed Jul 27 18:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:24.347174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd6b36-8291-4133-ae70-44a2ad9bd587 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:24.350461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd6b36-8291-4133-ae70-44a2ad9bd587 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:24.350461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd6b36-8291-4133-ae70-44a2ad9bd587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:24.422403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d5bd6b36-8291-4133-ae70-44a2ad9bd587 None None] MFA Rules not processed for user `9d4eba8e853c41bcbd92d6cab54efd0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:24.423593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d5bd6b36-8291-4133-ae70-44a2ad9bd587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:24.444002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:24.499151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 737/1474] 10.222.0.67 () {58 vars in 1063 bytes} [Wed Jul 27 18:18:24 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:24.507332 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50caf87-6135-4e00-81ca-cbbdf6567959 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:24.508824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c50caf87-6135-4e00-81ca-cbbdf6567959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:24.610918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50caf87-6135-4e00-81ca-cbbdf6567959 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:24.682123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6be4a5-eca8-425b-8062-6d795979216f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:24.682727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be4a5-eca8-425b-8062-6d795979216f service glance] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:24.683002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be4a5-eca8-425b-8062-6d795979216f service glance] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:24.683274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6be4a5-eca8-425b-8062-6d795979216f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:24.684856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0e6be4a5-eca8-425b-8062-6d795979216f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:24.738551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:24.793679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6be4a5-eca8-425b-8062-6d795979216f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:24.795169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6be4a5-eca8-425b-8062-6d795979216f service glance] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:24.813316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 738/1475] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:26.926757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505316-2b38-43bb-8f68-1dac02e760db None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:26.927294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505316-2b38-43bb-8f68-1dac02e760db None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:26.927294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0505316-2b38-43bb-8f68-1dac02e760db None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:26.928679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 738/1476] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:26.933954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a4e8-4081-4eef-acb0-f9183f77b002 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:26.934382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a4e8-4081-4eef-acb0-f9183f77b002 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:26.934486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f01a4e8-4081-4eef-acb0-f9183f77b002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:26.998646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6f01a4e8-4081-4eef-acb0-f9183f77b002 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:26.999858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6f01a4e8-4081-4eef-acb0-f9183f77b002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:27.093749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 739/1477] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:27.116768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0505316-2b38-43bb-8f68-1dac02e760db None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:27.118591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d0505316-2b38-43bb-8f68-1dac02e760db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:27.242637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0505316-2b38-43bb-8f68-1dac02e760db None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:27.290293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:27.332798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f8fc9f-0190-44f9-8bf0-e300d80ed348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:27.333405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8fc9f-0190-44f9-8bf0-e300d80ed348 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:27.333685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8fc9f-0190-44f9-8bf0-e300d80ed348 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:27.333993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f8fc9f-0190-44f9-8bf0-e300d80ed348 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:27.334864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8fc9f-0190-44f9-8bf0-e300d80ed348 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:27.337157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-14f8fc9f-0190-44f9-8bf0-e300d80ed348 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:18:27.337157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:18:27.337157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:18:27.338322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f8fc9f-0190-44f9-8bf0-e300d80ed348 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:27.356929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 739/1478] 10.222.0.67 () {56 vars in 1108 bytes} [Wed Jul 27 18:18:27 2022] GET /identity/v3/projects => generated 2553 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:18:29.384436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831e81e-3fa1-4d03-b3ef-a2f191b0b315 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:29.384980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831e81e-3fa1-4d03-b3ef-a2f191b0b315 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:29.384980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5831e81e-3fa1-4d03-b3ef-a2f191b0b315 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:29.386311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 740/1479] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:29.391534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2be9-5984-48a9-ab24-27ad8eb73d6e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:29.391967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2be9-5984-48a9-ab24-27ad8eb73d6e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:29.392079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc2be9-5984-48a9-ab24-27ad8eb73d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:29.456435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-0dcc2be9-5984-48a9-ab24-27ad8eb73d6e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:29.457637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0dcc2be9-5984-48a9-ab24-27ad8eb73d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:29.553695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 740/1480] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:18:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:29.596819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831e81e-3fa1-4d03-b3ef-a2f191b0b315 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:29.598411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5831e81e-3fa1-4d03-b3ef-a2f191b0b315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:29.608028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:29.744400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5831e81e-3fa1-4d03-b3ef-a2f191b0b315 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:29.822704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:29.854353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ccf8a-87db-4fd6-946d-40f56a4f443f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:29.855195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ccf8a-87db-4fd6-946d-40f56a4f443f service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:29.855667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ccf8a-87db-4fd6-946d-40f56a4f443f service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:29.856225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ccf8a-87db-4fd6-946d-40f56a4f443f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:29.858171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-308ccf8a-87db-4fd6-946d-40f56a4f443f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:29.946925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ccf8a-87db-4fd6-946d-40f56a4f443f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:29.948496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308ccf8a-87db-4fd6-946d-40f56a4f443f service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:29.969379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 741/1481] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:32.115147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe222b-cf74-4e51-b104-cb430f8d0123 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:32.115539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe222b-cf74-4e51-b104-cb430f8d0123 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:32.115706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fe222b-cf74-4e51-b104-cb430f8d0123 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:32.117343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 741/1482] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:32.122737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9395cd-2f59-4b2f-a0d9-730c8446be19 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:32.123150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9395cd-2f59-4b2f-a0d9-730c8446be19 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:32.123280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9395cd-2f59-4b2f-a0d9-730c8446be19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:32.190376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6d9395cd-2f59-4b2f-a0d9-730c8446be19 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:32.191587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6d9395cd-2f59-4b2f-a0d9-730c8446be19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:32.237692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:32.288292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 742/1483] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:32.323566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe222b-cf74-4e51-b104-cb430f8d0123 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:32.325097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-99fe222b-cf74-4e51-b104-cb430f8d0123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:32.350575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:32.430193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fe222b-cf74-4e51-b104-cb430f8d0123 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:32.501640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24806c-a6d9-4291-ae41-8b22e43f76aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:32.502284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24806c-a6d9-4291-ae41-8b22e43f76aa service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:32.502561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24806c-a6d9-4291-ae41-8b22e43f76aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:32.502833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24806c-a6d9-4291-ae41-8b22e43f76aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:32.504433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9e24806c-a6d9-4291-ae41-8b22e43f76aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:32.576216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:32.609820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24806c-a6d9-4291-ae41-8b22e43f76aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:32.611292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24806c-a6d9-4291-ae41-8b22e43f76aa service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:32.630645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 742/1484] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:34.696073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073eba-18cf-41f6-b891-ea87eb91aa10 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:34.696589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073eba-18cf-41f6-b891-ea87eb91aa10 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:34.696589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7073eba-18cf-41f6-b891-ea87eb91aa10 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:34.698052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 743/1485] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:18:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:34.703130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1f3a-de3e-44e0-8fa0-6d31b2eb64a6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:34.703561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1f3a-de3e-44e0-8fa0-6d31b2eb64a6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:34.703672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d1f3a-de3e-44e0-8fa0-6d31b2eb64a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:34.770512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d84d1f3a-de3e-44e0-8fa0-6d31b2eb64a6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:34.771744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d84d1f3a-de3e-44e0-8fa0-6d31b2eb64a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:34.867555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 743/1486] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:18:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:34.909688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7073eba-18cf-41f6-b891-ea87eb91aa10 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:34.911391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e7073eba-18cf-41f6-b891-ea87eb91aa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:35.016328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7073eba-18cf-41f6-b891-ea87eb91aa10 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:35.087421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:35.089192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c972642e-99e8-4a7d-bd4c-e5b929b96ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:35.089829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972642e-99e8-4a7d-bd4c-e5b929b96ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:35.090111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972642e-99e8-4a7d-bd4c-e5b929b96ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:35.090433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c972642e-99e8-4a7d-bd4c-e5b929b96ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:35.092048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c972642e-99e8-4a7d-bd4c-e5b929b96ef3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:35.200750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972642e-99e8-4a7d-bd4c-e5b929b96ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:35.202165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c972642e-99e8-4a7d-bd4c-e5b929b96ef3 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:35.222225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 744/1487] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:37.361312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a56757-1f9f-49dc-9d98-32df100611cd None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:37.361985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a56757-1f9f-49dc-9d98-32df100611cd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:37.361985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a56757-1f9f-49dc-9d98-32df100611cd None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:37.363294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 744/1488] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:37.368656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b96b8-672d-446a-9c45-7940023a801d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:37.369048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b96b8-672d-446a-9c45-7940023a801d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:37.369212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b96b8-672d-446a-9c45-7940023a801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:37.434365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d20b96b8-672d-446a-9c45-7940023a801d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:37.435598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d20b96b8-672d-446a-9c45-7940023a801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:37.488738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:37.533757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 745/1489] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:18:37.573367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a56757-1f9f-49dc-9d98-32df100611cd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:37.574953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c8a56757-1f9f-49dc-9d98-32df100611cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:37.610978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:37.679082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a56757-1f9f-49dc-9d98-32df100611cd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:37.751947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e518cc-dbea-4176-85cf-5995cb3d4222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:37.752603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e518cc-dbea-4176-85cf-5995cb3d4222 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:37.752951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e518cc-dbea-4176-85cf-5995cb3d4222 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:37.753228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e518cc-dbea-4176-85cf-5995cb3d4222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:37.754867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-91e518cc-dbea-4176-85cf-5995cb3d4222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:37.833968 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:37.863346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e518cc-dbea-4176-85cf-5995cb3d4222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:37.864771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e518cc-dbea-4176-85cf-5995cb3d4222 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:37.883153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 745/1490] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:40.213193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3290-800f-4989-beb8-79328812a3b4 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:40.213705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3290-800f-4989-beb8-79328812a3b4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:40.213847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be3290-800f-4989-beb8-79328812a3b4 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:40.215210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 746/1491] 10.222.0.67 () {54 vars in 926 bytes} [Wed Jul 27 18:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:18:40.220427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd46-e394-463d-9b16-72e19454448a None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:40.220821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd46-e394-463d-9b16-72e19454448a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:40.220974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623bd46-e394-463d-9b16-72e19454448a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:40.286421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b623bd46-e394-463d-9b16-72e19454448a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:18:40.287642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b623bd46-e394-463d-9b16-72e19454448a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:40.381202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 746/1492] 10.222.0.67 () {58 vars in 1023 bytes} [Wed Jul 27 18:18:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:18:40.419942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3290-800f-4989-beb8-79328812a3b4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:18:40.422033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-69be3290-800f-4989-beb8-79328812a3b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:40.523989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be3290-800f-4989-beb8-79328812a3b4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:18:40.596843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6929d8d5-c0cb-4449-8082-2af0af6961bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:18:40.597442 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d8d5-c0cb-4449-8082-2af0af6961bf service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:18:40.597715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d8d5-c0cb-4449-8082-2af0af6961bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:18:40.598008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6929d8d5-c0cb-4449-8082-2af0af6961bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:18:40.599595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6929d8d5-c0cb-4449-8082-2af0af6961bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:18:40.608966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:40.709011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929d8d5-c0cb-4449-8082-2af0af6961bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:18:40.710451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6929d8d5-c0cb-4449-8082-2af0af6961bf service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:18:40.729128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 747/1493] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:18:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:18:50.379449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=82 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:18:50.726779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=50 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:20:39.436038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d573a-3898-4bf0-8178-4beef8e7b82e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:39.436607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d573a-3898-4bf0-8178-4beef8e7b82e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:39.436607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648d573a-3898-4bf0-8178-4beef8e7b82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:39.517646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-648d573a-3898-4bf0-8178-4beef8e7b82e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:20:39.518884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-648d573a-3898-4bf0-8178-4beef8e7b82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:20:39.620148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 747/1494] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:20:39.628116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553c17-6cd6-4686-9823-2247996e4c55 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:39.628597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553c17-6cd6-4686-9823-2247996e4c55 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:39.628703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7553c17-6cd6-4686-9823-2247996e4c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:39.648215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c7553c17-6cd6-4686-9823-2247996e4c55 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:20:39.649396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c7553c17-6cd6-4686-9823-2247996e4c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:20:39.657861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 748/1495] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:20:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:20:39.662178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d573a-3898-4bf0-8178-4beef8e7b82e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:39.672199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648d573a-3898-4bf0-8178-4beef8e7b82e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:39.676807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:39.677410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:39.677685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:39.677983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:39.678661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:20:39.678956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:39.680500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:39.680500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:20:39.680500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:20:39.681375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:39.692619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 748/1496] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:20:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:20:39.700683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7553c17-6cd6-4686-9823-2247996e4c55 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:39.710027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7553c17-6cd6-4686-9823-2247996e4c55 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:39.714644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:39.715248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:39.715526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:39.715797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:39.716450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:39.718231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING py.warnings [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:39.718231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: warnings.warn(msg) Jul 27 18:20:39.718231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: Jul 27 18:20:39.719417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:39.829352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 749/1497] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:20:39 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:20:39.833492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:39.843432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb8f7d-0378-4f20-aedd-1b6eac620a7d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:39.893445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:20:39.900155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:39.901551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:39.901551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:39.901551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:39.902016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:39.903024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:39.903024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:20:39.903024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:20:39.904209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:39.988129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 749/1498] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:20:39 2022] POST /identity/v3/users => generated 290 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:20:39.992238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:40.002531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27443e99-d0d8-47da-95eb-f175b0382f91 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:40.007247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:40.007856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.008140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.008412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.009100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:40.010303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING py.warnings [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:40.010303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: warnings.warn(msg) Jul 27 18:20:40.010303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: Jul 27 18:20:40.011186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:40.024361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 750/1499] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:20:40.028495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:40.038587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe2db14-c0cb-416f-9006-9e6a1fe82ba6 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:40.043886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5d95e-52e0-4bab-b935-1e2fc163c00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:40.044534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d95e-52e0-4bab-b935-1e2fc163c00d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.044811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d95e-52e0-4bab-b935-1e2fc163c00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.045081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5d95e-52e0-4bab-b935-1e2fc163c00d admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.045796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d95e-52e0-4bab-b935-1e2fc163c00d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:40.046797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-efa5d95e-52e0-4bab-b935-1e2fc163c00d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:40.046797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:20:40.046797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:20:40.047665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5d95e-52e0-4bab-b935-1e2fc163c00d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:40.060891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 750/1500] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:20:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:20:40.064941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:40.074620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0285a3-cf39-46c3-9f20-08c3e918680e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:40.079189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1846d8f2-4811-435f-bb6b-d466fbf5b690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:40.079837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d8f2-4811-435f-bb6b-d466fbf5b690 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.080116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d8f2-4811-435f-bb6b-d466fbf5b690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.080389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1846d8f2-4811-435f-bb6b-d466fbf5b690 admin admin] PATH_INFO: `/v3/projects/ab5178cbed18417d8bda7e339667a44d/users/521593baeb92484f89d96dd3390af159/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.095448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846d8f2-4811-435f-bb6b-d466fbf5b690 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab5178cbed18417d8bda7e339667a44d, user_id=521593baeb92484f89d96dd3390af159, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:40.096487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING py.warnings [None req-1846d8f2-4811-435f-bb6b-d466fbf5b690 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:40.096487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: warnings.warn(msg) Jul 27 18:20:40.096487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: Jul 27 18:20:40.098448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1846d8f2-4811-435f-bb6b-d466fbf5b690 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:40.176825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 751/1501] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:20:40 2022] PUT /identity/v3/projects/ab5178cbed18417d8bda7e339667a44d/users/521593baeb92484f89d96dd3390af159/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:20:40.188914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9f26-d416-4331-9073-4f86a2e3e59a None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.189201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9f26-d416-4331-9073-4f86a2e3e59a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.191365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a9f26-d416-4331-9073-4f86a2e3e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.217484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-cb4a9f26-d416-4331-9073-4f86a2e3e59a None None] MFA Rules not processed for user `521593baeb92484f89d96dd3390af159`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:20:40.218732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cb4a9f26-d416-4331-9073-4f86a2e3e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:20:40.282362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 751/1502] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:20:40.295924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f303-2674-43f0-9b51-b770359e7bb4 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.296211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f303-2674-43f0-9b51-b770359e7bb4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.296487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698f303-2674-43f0-9b51-b770359e7bb4 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.297869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 752/1503] 10.222.0.67 () {54 vars in 964 bytes} [Wed Jul 27 18:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:20:40.302573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061861cf-4640-425b-bdcb-1263288be3a0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.302862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061861cf-4640-425b-bdcb-1263288be3a0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.303136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061861cf-4640-425b-bdcb-1263288be3a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.361255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-061861cf-4640-425b-bdcb-1263288be3a0 None None] MFA Rules not processed for user `0d75852e9db24464bd69c0c19b75ab39`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:20:40.362467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-061861cf-4640-425b-bdcb-1263288be3a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:20:40.436129 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 752/1504] 10.222.0.67 () {58 vars in 1061 bytes} [Wed Jul 27 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:20:40.443830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f303-2674-43f0-9b51-b770359e7bb4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:40.454831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698f303-2674-43f0-9b51-b770359e7bb4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:40.458308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:40.458917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.459191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.459461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.468379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:40.469828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:40.478798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 753/1505] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:20:40 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:20:40.524332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ca52-2571-45eb-9cc1-6a2e436f9aa7 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.524615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ca52-2571-45eb-9cc1-6a2e436f9aa7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.524884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9943ca52-2571-45eb-9cc1-6a2e436f9aa7 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.526220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 753/1506] 10.222.0.67 () {52 vars in 830 bytes} [Wed Jul 27 18:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:20:40.529847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:40.591371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ea8e9-6916-40c1-b94d-69a96957e7cf service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:40.595967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:40.596599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.596879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.597165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] PATH_INFO: `/v3/users/521593baeb92484f89d96dd3390af159` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.598374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=521593baeb92484f89d96dd3390af159)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:40.599381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING py.warnings [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:40.599381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: warnings.warn(msg) Jul 27 18:20:40.599381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: Jul 27 18:20:40.600585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:40.794439 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '521593baeb92484f89d96dd3390af159'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:40.795181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '521593baeb92484f89d96dd3390af159'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:40.814009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '521593baeb92484f89d96dd3390af159'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:40.814675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '521593baeb92484f89d96dd3390af159'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:40.883794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '521593baeb92484f89d96dd3390af159'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:40.892512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:20:40.904612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 754/1507] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:20:40 2022] DELETE /identity/v3/users/521593baeb92484f89d96dd3390af159 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:20:40.909124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:40.909411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:40.909686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:40.928383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:20:40.929609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:20:40.939161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:20:40.987751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 754/1508] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:20:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:20:40.998208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:40.999689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:20:41.076416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0c1102-3b42-4743-8312-e7638201e8fd admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:41.080030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb662d-de94-4ed5-8749-24ce508f357b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:41.080638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb662d-de94-4ed5-8749-24ce508f357b service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:41.080914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb662d-de94-4ed5-8749-24ce508f357b service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:41.081183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb662d-de94-4ed5-8749-24ce508f357b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:41.090074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb662d-de94-4ed5-8749-24ce508f357b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:41.091484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb662d-de94-4ed5-8749-24ce508f357b service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:41.101619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 755/1509] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:20:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:20:41.628193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:20:41.629691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:20:41.641736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57c77e-6a5e-4740-adca-425d9cc48ed5 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:20:41.646555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:20:41.650750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:20:41.650750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:20:41.650750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] PATH_INFO: `/v3/projects/ab5178cbed18417d8bda7e339667a44d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:20:41.650750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab5178cbed18417d8bda7e339667a44d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:20:41.651382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:20:41.651382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:20:41.651382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:20:41.652405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:20:41.790466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab5178cbed18417d8bda7e339667a44d', 'request_id': 'req-adb7be3c-77b5-4aec-9656-50a995b30a3c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:41.885459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab5178cbed18417d8bda7e339667a44d', 'request_id': 'req-adb7be3c-77b5-4aec-9656-50a995b30a3c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:41.892309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab5178cbed18417d8bda7e339667a44d', 'request_id': 'req-adb7be3c-77b5-4aec-9656-50a995b30a3c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:41.911465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] The token cache is being invalidate because project ab5178cbed18417d8bda7e339667a44d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:20:41.911753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:41.912389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-adb7be3c-77b5-4aec-9656-50a995b30a3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:20:41.914049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 755/1510] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:20:41 2022] DELETE /identity/v3/projects/ab5178cbed18417d8bda7e339667a44d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:20:51.097454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=38 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:20:51.908512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:22:24.411568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508f85-6b85-4041-8017-103836fe2d7f None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:24.412121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508f85-6b85-4041-8017-103836fe2d7f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:24.412121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa508f85-6b85-4041-8017-103836fe2d7f None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:24.413422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 756/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:22:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:24.418534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453832ec-7982-41da-8887-02f3ca5b0847 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:24.418948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453832ec-7982-41da-8887-02f3ca5b0847 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:24.419114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453832ec-7982-41da-8887-02f3ca5b0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:24.438472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-453832ec-7982-41da-8887-02f3ca5b0847 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:24.445842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-453832ec-7982-41da-8887-02f3ca5b0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:24.498486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 756/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:24.653059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508f85-6b85-4041-8017-103836fe2d7f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:24.655287 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-aa508f85-6b85-4041-8017-103836fe2d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:24.759640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa508f85-6b85-4041-8017-103836fe2d7f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:24.765420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24352c78-b333-408f-82d3-fc92f8de6340 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:24.766069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24352c78-b333-408f-82d3-fc92f8de6340 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:24.766354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24352c78-b333-408f-82d3-fc92f8de6340 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:24.766628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24352c78-b333-408f-82d3-fc92f8de6340 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:24.774771 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24352c78-b333-408f-82d3-fc92f8de6340 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:24.776355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24352c78-b333-408f-82d3-fc92f8de6340 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:24.786297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 757/1513] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:25.611907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033cd43-3cff-4a83-9b34-0b11a506d999 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:25.612477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033cd43-3cff-4a83-9b34-0b11a506d999 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:25.612477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a033cd43-3cff-4a83-9b34-0b11a506d999 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:25.613928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 757/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:25.618670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4cb9-7cc5-4898-a650-0038332d64db None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:25.619094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4cb9-7cc5-4898-a650-0038332d64db None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:25.619208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8f4cb9-7cc5-4898-a650-0038332d64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:25.639791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4f8f4cb9-7cc5-4898-a650-0038332d64db None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:25.640999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4f8f4cb9-7cc5-4898-a650-0038332d64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:25.649048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 758/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:25.802233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033cd43-3cff-4a83-9b34-0b11a506d999 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:25.817706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a033cd43-3cff-4a83-9b34-0b11a506d999 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:25.823446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83ec21f-c1f5-4610-a382-c6bf72eecd02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:25.824069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec21f-c1f5-4610-a382-c6bf72eecd02 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:25.824347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec21f-c1f5-4610-a382-c6bf72eecd02 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:25.824621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83ec21f-c1f5-4610-a382-c6bf72eecd02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:25.832977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ec21f-c1f5-4610-a382-c6bf72eecd02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:25.834601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83ec21f-c1f5-4610-a382-c6bf72eecd02 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:25.843931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 758/1516] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:25.850211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9516b-f77a-4c64-a84c-cd0c1472e24f None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:25.850554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9516b-f77a-4c64-a84c-cd0c1472e24f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:25.850898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9516b-f77a-4c64-a84c-cd0c1472e24f None None] PATH_INFO: `/v3` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:25.852359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 759/1517] 10.222.0.40 () {54 vars in 925 bytes} [Wed Jul 27 18:22:25 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:22:25.859119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a10cc-b035-4116-a42f-ca239119c94c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:25.859520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a10cc-b035-4116-a42f-ca239119c94c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:25.859801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a10cc-b035-4116-a42f-ca239119c94c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:25.914287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-762a10cc-b035-4116-a42f-ca239119c94c None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:25.915518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-762a10cc-b035-4116-a42f-ca239119c94c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:25.988641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 759/1518] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 27 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:30.089651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0570a-2b03-46e6-8893-12d42d700e9c None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:30.090225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0570a-2b03-46e6-8893-12d42d700e9c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:30.090225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed0570a-2b03-46e6-8893-12d42d700e9c None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:30.091479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 760/1519] 10.222.0.67 () {54 vars in 961 bytes} [Wed Jul 27 18:22:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:30.096438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7a1b-b75c-43b0-a5ed-5341d6ad5c1d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:30.096880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7a1b-b75c-43b0-a5ed-5341d6ad5c1d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:30.096983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f7a1b-b75c-43b0-a5ed-5341d6ad5c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:30.116822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a35f7a1b-b75c-43b0-a5ed-5341d6ad5c1d None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:30.118049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a35f7a1b-b75c-43b0-a5ed-5341d6ad5c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:30.127057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 760/1520] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Jul 27 18:22:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:30.134655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0570a-2b03-46e6-8893-12d42d700e9c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:30.153071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed0570a-2b03-46e6-8893-12d42d700e9c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:30.162078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48625c50-2075-47f3-8c1e-de1df6dc364b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:30.162809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48625c50-2075-47f3-8c1e-de1df6dc364b service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:30.163099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48625c50-2075-47f3-8c1e-de1df6dc364b service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:30.163378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48625c50-2075-47f3-8c1e-de1df6dc364b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:30.174428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48625c50-2075-47f3-8c1e-de1df6dc364b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:30.176027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48625c50-2075-47f3-8c1e-de1df6dc364b service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:30.186308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 761/1521] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:37.085912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c94ab1-7f11-4fba-81f9-ec34afe4a415 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:37.086479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c94ab1-7f11-4fba-81f9-ec34afe4a415 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:37.086479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c94ab1-7f11-4fba-81f9-ec34afe4a415 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:37.087832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 761/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:22:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:37.093173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d53a2-58bc-4b13-b247-c294f9048cbc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:37.093568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d53a2-58bc-4b13-b247-c294f9048cbc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:37.093715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d53a2-58bc-4b13-b247-c294f9048cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:37.113202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-839d53a2-58bc-4b13-b247-c294f9048cbc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:37.114430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-839d53a2-58bc-4b13-b247-c294f9048cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:37.122322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 762/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:37.276102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c94ab1-7f11-4fba-81f9-ec34afe4a415 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:37.290554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c94ab1-7f11-4fba-81f9-ec34afe4a415 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:37.296580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c36666-e544-4f88-a731-c37494f4ae05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:37.297182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36666-e544-4f88-a731-c37494f4ae05 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:37.297462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36666-e544-4f88-a731-c37494f4ae05 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:37.297735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c36666-e544-4f88-a731-c37494f4ae05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:37.306167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c36666-e544-4f88-a731-c37494f4ae05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:37.307803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c36666-e544-4f88-a731-c37494f4ae05 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:37.318069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 762/1524] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:38.133295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfdd61-45b1-4e53-9ae3-2def3b05cd30 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:38.133747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfdd61-45b1-4e53-9ae3-2def3b05cd30 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:38.133887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cfdd61-45b1-4e53-9ae3-2def3b05cd30 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:38.135256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 763/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 27 18:22:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:38.140125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3907d-e4a8-4561-b854-e296562da11b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:38.140556 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3907d-e4a8-4561-b854-e296562da11b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:38.140671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3907d-e4a8-4561-b854-e296562da11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:38.160856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-68e3907d-e4a8-4561-b854-e296562da11b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:38.162141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-68e3907d-e4a8-4561-b854-e296562da11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:38.170521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 763/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 27 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:38.321881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfdd61-45b1-4e53-9ae3-2def3b05cd30 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:38.336870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cfdd61-45b1-4e53-9ae3-2def3b05cd30 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:38.342384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a016b7-900c-438a-a6b9-c57759620267 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:38.342992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a016b7-900c-438a-a6b9-c57759620267 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:38.343268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a016b7-900c-438a-a6b9-c57759620267 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:38.343538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a016b7-900c-438a-a6b9-c57759620267 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:38.351784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a016b7-900c-438a-a6b9-c57759620267 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:38.353592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a016b7-900c-438a-a6b9-c57759620267 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:38.363033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 764/1527] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:42.251171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e979069-45d0-4109-b25a-4e6bc8759c38 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:42.251730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e979069-45d0-4109-b25a-4e6bc8759c38 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:42.251730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e979069-45d0-4109-b25a-4e6bc8759c38 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:42.253108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 764/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:42.258416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec5c5-caa1-4874-acfd-750956e414ba None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:42.258893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec5c5-caa1-4874-acfd-750956e414ba None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:42.258989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ec5c5-caa1-4874-acfd-750956e414ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:42.279379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c80ec5c5-caa1-4874-acfd-750956e414ba None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:42.280569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c80ec5c5-caa1-4874-acfd-750956e414ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:42.288436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 765/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:42.363107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e979069-45d0-4109-b25a-4e6bc8759c38 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:42.364743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5e979069-45d0-4109-b25a-4e6bc8759c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:42.393784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:22:42.422643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e979069-45d0-4109-b25a-4e6bc8759c38 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:42.426335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268f8494-a7ff-4d24-b539-26abb0e547ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:42.426946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8494-a7ff-4d24-b539-26abb0e547ee service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:42.427224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8494-a7ff-4d24-b539-26abb0e547ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:42.427498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268f8494-a7ff-4d24-b539-26abb0e547ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:42.436426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8494-a7ff-4d24-b539-26abb0e547ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:42.437880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268f8494-a7ff-4d24-b539-26abb0e547ee service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:42.447147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 765/1530] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:44.450987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4aa5-0c1c-4cb9-9e92-48d8aa694045 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:44.451522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4aa5-0c1c-4cb9-9e92-48d8aa694045 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:44.451522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab4aa5-0c1c-4cb9-9e92-48d8aa694045 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:44.452825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 766/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:22:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:44.457917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599fc62-1066-4f88-aa5b-2d804614ccf5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:44.458369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599fc62-1066-4f88-aa5b-2d804614ccf5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:44.458469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8599fc62-1066-4f88-aa5b-2d804614ccf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:44.477952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8599fc62-1066-4f88-aa5b-2d804614ccf5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:44.479155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8599fc62-1066-4f88-aa5b-2d804614ccf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:44.487058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 766/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:44.522919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4aa5-0c1c-4cb9-9e92-48d8aa694045 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:44.533580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab4aa5-0c1c-4cb9-9e92-48d8aa694045 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:44.537087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f9a2-2970-4f99-8713-3ee58fc5a914 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:44.537687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f9a2-2970-4f99-8713-3ee58fc5a914 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:44.537996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f9a2-2970-4f99-8713-3ee58fc5a914 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:44.538265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f9a2-2970-4f99-8713-3ee58fc5a914 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:44.547751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f9a2-2970-4f99-8713-3ee58fc5a914 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:44.549176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f9a2-2970-4f99-8713-3ee58fc5a914 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:44.558593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 767/1533] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:48.138912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759b724-7103-4065-8a56-191808c97c4a None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:48.139394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759b724-7103-4065-8a56-191808c97c4a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:48.139493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e759b724-7103-4065-8a56-191808c97c4a None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:48.140804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 767/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:22:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:48.145906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d859b-dfa5-4806-ae20-255c97310e74 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:48.146341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d859b-dfa5-4806-ae20-255c97310e74 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:48.146464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327d859b-dfa5-4806-ae20-255c97310e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:48.165832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-327d859b-dfa5-4806-ae20-255c97310e74 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:48.167031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-327d859b-dfa5-4806-ae20-255c97310e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:48.174951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 768/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:48.477919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759b724-7103-4065-8a56-191808c97c4a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:48.479620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e759b724-7103-4065-8a56-191808c97c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:48.539271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e759b724-7103-4065-8a56-191808c97c4a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:48.543078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d876e04a-5532-43b8-8f0e-5e31b14fe3a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:48.544246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876e04a-5532-43b8-8f0e-5e31b14fe3a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:48.544520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876e04a-5532-43b8-8f0e-5e31b14fe3a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:48.544788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d876e04a-5532-43b8-8f0e-5e31b14fe3a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:48.553966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876e04a-5532-43b8-8f0e-5e31b14fe3a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:48.555408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d876e04a-5532-43b8-8f0e-5e31b14fe3a8 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:48.565917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 768/1536] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:22:50.572869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784429f4-9491-4c38-b07d-87e0b45ae3f1 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:50.573430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784429f4-9491-4c38-b07d-87e0b45ae3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:50.573430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784429f4-9491-4c38-b07d-87e0b45ae3f1 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:50.575624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 769/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 27 18:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:22:50.580721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cbc9e-d265-4807-9889-703dacaac2f4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:50.581159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cbc9e-d265-4807-9889-703dacaac2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:50.581265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034cbc9e-d265-4807-9889-703dacaac2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:50.600900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-034cbc9e-d265-4807-9889-703dacaac2f4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:22:50.602414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-034cbc9e-d265-4807-9889-703dacaac2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:50.610090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 769/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 27 18:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:22:50.909998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784429f4-9491-4c38-b07d-87e0b45ae3f1 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:22:50.911693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-784429f4-9491-4c38-b07d-87e0b45ae3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:22:50.924623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784429f4-9491-4c38-b07d-87e0b45ae3f1 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:22:50.928242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd74ab5-8477-4331-84e4-e4331b359fc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:22:50.928874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74ab5-8477-4331-84e4-e4331b359fc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:22:50.929149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74ab5-8477-4331-84e4-e4331b359fc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:22:50.929420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd74ab5-8477-4331-84e4-e4331b359fc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:22:50.938878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd74ab5-8477-4331-84e4-e4331b359fc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:22:50.940293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd74ab5-8477-4331-84e4-e4331b359fc8 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:22:50.949718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 770/1539] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:22:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:23:00.595924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=47 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:23:00.945553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=82 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:22.978061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de61ac-2acb-40be-9072-fc483d72eaf8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:22.983024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de61ac-2acb-40be-9072-fc483d72eaf8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:22.983024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81de61ac-2acb-40be-9072-fc483d72eaf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.003595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-81de61ac-2acb-40be-9072-fc483d72eaf8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.005337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-81de61ac-2acb-40be-9072-fc483d72eaf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.018346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 770/1540] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.027979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea6ed-7566-443b-b2bd-52ed1634c2a7 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.028554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea6ed-7566-443b-b2bd-52ed1634c2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.028554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37aea6ed-7566-443b-b2bd-52ed1634c2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.060707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-37aea6ed-7566-443b-b2bd-52ed1634c2a7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.061950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-37aea6ed-7566-443b-b2bd-52ed1634c2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.064842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae547e-c5a9-4d1a-9b4d-ef752522727b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.065127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae547e-c5a9-4d1a-9b4d-ef752522727b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.065406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae547e-c5a9-4d1a-9b4d-ef752522727b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.075667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 771/1541] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:23.096871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3ac48-a653-4ed7-9973-2c800013bf02 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.097222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3ac48-a653-4ed7-9973-2c800013bf02 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.097438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f3ac48-a653-4ed7-9973-2c800013bf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.100916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-eaae547e-c5a9-4d1a-9b4d-ef752522727b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.102215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-eaae547e-c5a9-4d1a-9b4d-ef752522727b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.124863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 771/1542] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:23.125826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae547e-c5a9-4d1a-9b4d-ef752522727b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.144714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae547e-c5a9-4d1a-9b4d-ef752522727b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.153259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d0f3ac48-a653-4ed7-9973-2c800013bf02 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.154651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d0f3ac48-a653-4ed7-9973-2c800013bf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.160351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a372765-dac2-4ea4-b858-0f42d49de3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.161492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372765-dac2-4ea4-b858-0f42d49de3e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.161782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372765-dac2-4ea4-b858-0f42d49de3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.162052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a372765-dac2-4ea4-b858-0f42d49de3e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.162747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a372765-dac2-4ea4-b858-0f42d49de3e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.163052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a372765-dac2-4ea4-b858-0f42d49de3e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.165162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a372765-dac2-4ea4-b858-0f42d49de3e3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.175905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 772/1543] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:23.177803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11127-ac8b-414f-9311-1117273dafe8 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.178160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11127-ac8b-414f-9311-1117273dafe8 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.178396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b11127-ac8b-414f-9311-1117273dafe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.196247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 772/1544] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.197600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa20b1b-1e2d-4bde-9aa6-5d482145e00c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.197923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa20b1b-1e2d-4bde-9aa6-5d482145e00c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.198196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa20b1b-1e2d-4bde-9aa6-5d482145e00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.215158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e2b11127-ac8b-414f-9311-1117273dafe8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.216405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e2b11127-ac8b-414f-9311-1117273dafe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.231201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-cfa20b1b-1e2d-4bde-9aa6-5d482145e00c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.232392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cfa20b1b-1e2d-4bde-9aa6-5d482145e00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.247189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 773/1545] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.247882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11127-ac8b-414f-9311-1117273dafe8 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.250538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 773/1546] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.252198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa20b1b-1e2d-4bde-9aa6-5d482145e00c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.264353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b11127-ac8b-414f-9311-1117273dafe8 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.272948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa20b1b-1e2d-4bde-9aa6-5d482145e00c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.278383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474dcc0-6d8f-44d2-9bb5-9daf043cb7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.279019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474dcc0-6d8f-44d2-9bb5-9daf043cb7ad admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.279304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474dcc0-6d8f-44d2-9bb5-9daf043cb7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.279584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474dcc0-6d8f-44d2-9bb5-9daf043cb7ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.280106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.280252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474dcc0-6d8f-44d2-9bb5-9daf043cb7ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.280843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.281128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.281395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.282110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.282234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4474dcc0-6d8f-44d2-9bb5-9daf043cb7ad admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.282415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.283990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.308086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 774/1547] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.309011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.327989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f6d29-8ff9-4cd2-8c57-ab92a196cb7b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.343581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39fb698-7a39-4201-9225-f0c0ad2c52bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.349754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fb698-7a39-4201-9225-f0c0ad2c52bb admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.349754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fb698-7a39-4201-9225-f0c0ad2c52bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.349754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39fb698-7a39-4201-9225-f0c0ad2c52bb admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.349754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fb698-7a39-4201-9225-f0c0ad2c52bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.349754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fb698-7a39-4201-9225-f0c0ad2c52bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.349754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39fb698-7a39-4201-9225-f0c0ad2c52bb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.365409 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 775/1548] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.366786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69208fc2-e8c7-4c68-ae2b-020f07a570a0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.367084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69208fc2-e8c7-4c68-ae2b-020f07a570a0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.367357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69208fc2-e8c7-4c68-ae2b-020f07a570a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.393436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-69208fc2-e8c7-4c68-ae2b-020f07a570a0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.394886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-69208fc2-e8c7-4c68-ae2b-020f07a570a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.402935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 776/1549] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.403656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69208fc2-e8c7-4c68-ae2b-020f07a570a0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.413700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69208fc2-e8c7-4c68-ae2b-020f07a570a0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.419211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4146ebf-161c-461b-ae76-703396a216b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.419645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 774/1550] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/projects => generated 393 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:23.420079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146ebf-161c-461b-ae76-703396a216b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.420360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146ebf-161c-461b-ae76-703396a216b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.420634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4146ebf-161c-461b-ae76-703396a216b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.421241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690e32-71d2-4c5b-be41-38227635f60d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.421501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4146ebf-161c-461b-ae76-703396a216b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.421611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690e32-71d2-4c5b-be41-38227635f60d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.423001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53690e32-71d2-4c5b-be41-38227635f60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.424300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-b4146ebf-161c-461b-ae76-703396a216b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:24:23.424300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:24:23.424300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:24:23.424300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4146ebf-161c-461b-ae76-703396a216b0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.450751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-53690e32-71d2-4c5b-be41-38227635f60d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.453091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-53690e32-71d2-4c5b-be41-38227635f60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.518239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 775/1551] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.518987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53690e32-71d2-4c5b-be41-38227635f60d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.528481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53690e32-71d2-4c5b-be41-38227635f60d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.533047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6293e86b-075c-4f93-a73c-3826d9bc3a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.533653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e86b-075c-4f93-a73c-3826d9bc3a4d admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.533969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e86b-075c-4f93-a73c-3826d9bc3a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.534247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6293e86b-075c-4f93-a73c-3826d9bc3a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.534912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e86b-075c-4f93-a73c-3826d9bc3a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.537393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6293e86b-075c-4f93-a73c-3826d9bc3a4d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.538244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 777/1552] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/projects => generated 383 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:23.542596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb4c8-a92e-40b9-9c97-233e5cd9c477 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.542887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb4c8-a92e-40b9-9c97-233e5cd9c477 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.543167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fabb4c8-a92e-40b9-9c97-233e5cd9c477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.562180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9fabb4c8-a92e-40b9-9c97-233e5cd9c477 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.563375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9fabb4c8-a92e-40b9-9c97-233e5cd9c477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.621554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 778/1553] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.622830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45f66-43f0-4266-9266-d3bc7f8ea8af None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.623116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45f66-43f0-4266-9266-d3bc7f8ea8af None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.623393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e45f66-43f0-4266-9266-d3bc7f8ea8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.636714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 776/1554] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:23.641644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2abdf5-4899-4786-a195-f5f2a8849de7 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.641644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2abdf5-4899-4786-a195-f5f2a8849de7 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.641644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2abdf5-4899-4786-a195-f5f2a8849de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.642650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-14e45f66-43f0-4266-9266-d3bc7f8ea8af None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.643846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-14e45f66-43f0-4266-9266-d3bc7f8ea8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.657459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-1d2abdf5-4899-4786-a195-f5f2a8849de7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.658659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1d2abdf5-4899-4786-a195-f5f2a8849de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.701103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 779/1555] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.701951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45f66-43f0-4266-9266-d3bc7f8ea8af None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.710853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e45f66-43f0-4266-9266-d3bc7f8ea8af None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.717035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af8f5ab-5cd6-4638-a05e-9051c96d0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.717628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f5ab-5cd6-4638-a05e-9051c96d0978 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.717933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f5ab-5cd6-4638-a05e-9051c96d0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.718206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af8f5ab-5cd6-4638-a05e-9051c96d0978 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.718862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f5ab-5cd6-4638-a05e-9051c96d0978 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.720766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af8f5ab-5cd6-4638-a05e-9051c96d0978 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.721010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 777/1556] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.722542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f79c-7699-4c2e-bee0-fe7fda55b03a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.722829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f79c-7699-4c2e-bee0-fe7fda55b03a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.723628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78f79c-7699-4c2e-bee0-fe7fda55b03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.733690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:23.742477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3d78f79c-7699-4c2e-bee0-fe7fda55b03a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.748323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3d78f79c-7699-4c2e-bee0-fe7fda55b03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.751584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 778/1557] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.752747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3019f5-f4c7-4cc6-be76-945b9df41581 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.753028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3019f5-f4c7-4cc6-be76-945b9df41581 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.753299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3019f5-f4c7-4cc6-be76-945b9df41581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.773045 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5a3019f5-f4c7-4cc6-be76-945b9df41581 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.774177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5a3019f5-f4c7-4cc6-be76-945b9df41581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.782006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 779/1558] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.786224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3019f5-f4c7-4cc6-be76-945b9df41581 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.792230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3019f5-f4c7-4cc6-be76-945b9df41581 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.796725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.797295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.797664 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.797938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.798578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.799585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING py.warnings [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:24:23.799585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: warnings.warn(msg) Jul 27 18:24:23.799585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: Jul 27 18:24:23.800779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.805982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 780/1559] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:23.808948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb44db-287b-46d4-ab7d-c5d12c5772a8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.808948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb44db-287b-46d4-ab7d-c5d12c5772a8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.808948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb44db-287b-46d4-ab7d-c5d12c5772a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.827607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-23eb44db-287b-46d4-ab7d-c5d12c5772a8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.831361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-23eb44db-287b-46d4-ab7d-c5d12c5772a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.837302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 781/1560] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.838075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb44db-287b-46d4-ab7d-c5d12c5772a8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.847243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb44db-287b-46d4-ab7d-c5d12c5772a8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.852240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.852812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.853089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.853360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.854030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.855918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.900426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 780/1561] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:23.901331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.911212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468b8a77-1468-4a2e-ac68-218980e9a9bb admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.915837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.916417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.916698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.916971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.917647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.917978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.918983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING py.warnings [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:24:23.918983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: warnings.warn(msg) Jul 27 18:24:23.918983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: Jul 27 18:24:23.919850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af121bd-a56a-4648-ba44-8482c676f6ff admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.921284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:23.932967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 781/1562] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.934202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7955d-733b-4ac4-8a5c-b435f2fb7564 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.934483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7955d-733b-4ac4-8a5c-b435f2fb7564 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.934753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e7955d-733b-4ac4-8a5c-b435f2fb7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.952923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-61e7955d-733b-4ac4-8a5c-b435f2fb7564 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.954184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-61e7955d-733b-4ac4-8a5c-b435f2fb7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.962829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 782/1563] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.966466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 782/1564] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:23.966466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.966674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f451-e544-4eff-9c53-e397d3f03cba None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.966674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f451-e544-4eff-9c53-e397d3f03cba None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.966674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0f451-e544-4eff-9c53-e397d3f03cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.975309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6071ec3b-e917-4950-884f-45a011eaf97a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:23.980153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:23.980795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:23.981035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:23.981311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:23.982033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:23.982339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:23.983931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:23.984495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b0c0f451-e544-4eff-9c53-e397d3f03cba None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:23.985684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b0c0f451-e544-4eff-9c53-e397d3f03cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:23.996914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 783/1565] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:23.997056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0f451-e544-4eff-9c53-e397d3f03cba None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:23.997570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 783/1566] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:23.998500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.012938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0f451-e544-4eff-9c53-e397d3f03cba None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.013165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da92e22-32a6-4fea-8265-1fc14d7f1e7a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.017665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.017939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.018318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.018546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.018653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.018828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.018932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.019110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.019545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.019857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:24.020159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.021134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.021731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.031574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 784/1567] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:24.032433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.042887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 784/1568] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:24.042887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.043197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa2acd-4a46-49b3-a2f8-f93378d7f784 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.048169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.048420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697740db-437c-4570-af5f-f1da6fe7fe2d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.048777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.049063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.049338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.050075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.052187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.053482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.054111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.054394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.054669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.055349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.057241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.062316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 785/1569] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:24.063255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.073176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dae0a5-4edd-4647-80b8-2bc529a58cf4 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.077736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.078347 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.078629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.078904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.079578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.081144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.091509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 786/1570] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:24.092293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.101993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe1308-f7dd-47bb-b5f2-0c25fe5484af admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.106690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.107281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.107563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.107839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.108521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:24.108823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.110606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.122963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 787/1571] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:24.123759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.133871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6266451d-3786-4799-9819-485a7c87e9e8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.138544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.139136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.139415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.139688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.140364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:24.140669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.142369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.151035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 785/1572] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/projects => generated 371 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:24.151035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.162837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 788/1573] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:24.162837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.166841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37879e25-cd7c-4834-a409-6cc11ce2afa1 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.216053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec351a2-fe45-4b32-aaf7-8ea36af01431 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.220814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.221686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.222002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.222278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.222934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.224457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.224972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.225091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.225322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.225617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.226295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.227934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.237674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 789/1574] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:24.237674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.249887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2070d9-d679-4a2d-ad1e-d2c5b02f65ae admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.255096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.255677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.255952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.256632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.256849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.258882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.310638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 786/1575] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/projects => generated 389 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:24.310638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.368454 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1905c-f083-437a-bbb5-9a1481622725 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.373220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.373883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.374147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.374416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.375100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.376714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.386464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 787/1576] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:24.387233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.392863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:24.396559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a89791-d510-446b-9d2a-dc206f4a48fd admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.401223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.401819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.402103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.402376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.403032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.404552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.415853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 788/1577] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:24.415853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.418137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 790/1578] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/projects => generated 379 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:24.418137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.425239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e233641-ba05-4b8f-ba0d-3bee7f6cfa36 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.478314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:24.480110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.480739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.481020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.481291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.481982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.483516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce77fa-201e-4208-8c41-94d968359622 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.484015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.489833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.494147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.494147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.494147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.494147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.494147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.629989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 789/1579] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/projects => generated 405 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:24.629989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.657596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 791/1580] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:24.657596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.667874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090b015b-bef5-4c5d-adee-51dc3056f6ac admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.689436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218bfb3-cffe-4c68-940f-ea3da0e22436 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.694949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.695585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.695864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.696145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.696811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.698782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.724491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.728652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.728652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.728652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] PATH_INFO: `/v3/projects/2ce893126b194910ba9de063a09a3387/users/8bbfd4cdd3ba4066ab933f00433c8164/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.739860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ce893126b194910ba9de063a09a3387, user_id=8bbfd4cdd3ba4066ab933f00433c8164, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.742584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.792943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 790/1581] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:24.793759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.826508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 792/1582] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:24 2022] PUT /identity/v3/projects/2ce893126b194910ba9de063a09a3387/users/8bbfd4cdd3ba4066ab933f00433c8164/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:24.849078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:24.865470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc32270-7b8e-4c6b-ab15-68210efc14eb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.894710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d181fb57-98d9-4924-ac57-aa0873fc410e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:24.895135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.895796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.896073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.896343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] PATH_INFO: `/v3/projects/448505ebcf1347cf83e47436593bd6aa/users/92babc56f5794ed684b4072af4a9c46b/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.910289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448505ebcf1347cf83e47436593bd6aa, user_id=92babc56f5794ed684b4072af4a9c46b, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.912982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:24.920482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:24.921345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:24.922061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:24.922342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:24.922616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:24.923271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:24.925172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.010982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 793/1583] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:24 2022] PUT /identity/v3/projects/448505ebcf1347cf83e47436593bd6aa/users/92babc56f5794ed684b4072af4a9c46b/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:25.011783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.042785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 791/1584] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:24 2022] POST /identity/v3/users => generated 295 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:25.042785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.050325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff0edeb-1631-4872-b69a-545a51aa6d2a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.066090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.076907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e2946-cb01-4c91-b4c9-51a670ec8306 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.081713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.082448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.082789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.083058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.083713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.085619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.108339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.109017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.109313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.109565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] PATH_INFO: `/v3/projects/2aaa747afc8c49128639f395778c644e/users/7977d8040e744736990407bdec928006/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.124486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aaa747afc8c49128639f395778c644e, user_id=7977d8040e744736990407bdec928006, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.135957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:24:25.135957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:24:25.135957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:24:25.135957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.182193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 794/1585] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:25.183462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.196727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e70402-baa2-47e0-a90d-3b4ab26ea1cc admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.201609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.202264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.202577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.202875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.203538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.205464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.250866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 792/1586] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:25 2022] PUT /identity/v3/projects/2aaa747afc8c49128639f395778c644e/users/7977d8040e744736990407bdec928006/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:25.251692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.311734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f101e64-7e37-4c69-9187-41f6210e3f0a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.316419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04e1e22-ba36-44a4-9629-f4600e5f1faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.317549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e1e22-ba36-44a4-9629-f4600e5f1faa admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.317866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e1e22-ba36-44a4-9629-f4600e5f1faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.318139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04e1e22-ba36-44a4-9629-f4600e5f1faa admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.318821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e1e22-ba36-44a4-9629-f4600e5f1faa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.320430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04e1e22-ba36-44a4-9629-f4600e5f1faa admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.326244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 795/1587] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/users => generated 303 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:25.326244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.331281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 793/1588] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.334490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a2f3c-6d8d-4086-8de5-7368e8f0f43f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.335998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b336412-2937-40a2-8d77-310161c724bd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.336288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b336412-2937-40a2-8d77-310161c724bd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.336563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b336412-2937-40a2-8d77-310161c724bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.339120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.339722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.340006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.340278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.340930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.342886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.356023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-2b336412-2937-40a2-8d77-310161c724bd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:25.357205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2b336412-2937-40a2-8d77-310161c724bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:25.366198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 794/1589] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:25.367485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35194633-87e3-47c5-8276-1e92be5e887c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.367777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35194633-87e3-47c5-8276-1e92be5e887c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.368050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35194633-87e3-47c5-8276-1e92be5e887c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.393124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.396582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-35194633-87e3-47c5-8276-1e92be5e887c None None] MFA Rules not processed for user `92babc56f5794ed684b4072af4a9c46b`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:25.403230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-35194633-87e3-47c5-8276-1e92be5e887c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:25.443291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 796/1590] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:25.443291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.452636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57905f3-31e7-4f05-9102-f5c8b202ac0c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.457682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cb578d-d0b6-4168-840e-2fb8e1bde68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.458317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb578d-d0b6-4168-840e-2fb8e1bde68a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.458597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb578d-d0b6-4168-840e-2fb8e1bde68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.458871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cb578d-d0b6-4168-840e-2fb8e1bde68a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.459554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb578d-d0b6-4168-840e-2fb8e1bde68a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.461136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cb578d-d0b6-4168-840e-2fb8e1bde68a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.461514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 795/1591] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:25.462389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35194633-87e3-47c5-8276-1e92be5e887c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.480250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 797/1592] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.480250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48be10-6098-4a7e-b928-eec4b4e8f60f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.480250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48be10-6098-4a7e-b928-eec4b4e8f60f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.480250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48be10-6098-4a7e-b928-eec4b4e8f60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.481027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35194633-87e3-47c5-8276-1e92be5e887c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.486099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.487333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.495029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.495029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.495029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.495029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.502497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 796/1593] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.503414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.509707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-2a48be10-6098-4a7e-b928-eec4b4e8f60f None None] MFA Rules not processed for user `7977d8040e744736990407bdec928006`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:25.510990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2a48be10-6098-4a7e-b928-eec4b4e8f60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:25.513638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f2d01b-8199-43bb-ab97-71f4bfdd954b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.518363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.518964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.519245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.519521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.520739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.522359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.532783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 797/1594] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.537310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.543512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e7a6af-d426-4f73-9702-25a66c111b6c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.548125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.548714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.549001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.549277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.549985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.552309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.563114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 798/1595] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.564013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.585301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 798/1596] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:25.586825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48be10-6098-4a7e-b928-eec4b4e8f60f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.598318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48be10-6098-4a7e-b928-eec4b4e8f60f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.603060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.603678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.604071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.604354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.605050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.606733 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.617422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 799/1597] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.618258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.626353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e4d31-8246-4ff8-a454-5e7d406ad088 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.627660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cdd460-5ac3-4d56-aa02-de7cedb4e5f0 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.630753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.631363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.631641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.631962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.633161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da104b33-a66d-479f-88e8-f76bdbda33b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.633930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104b33-a66d-479f-88e8-f76bdbda33b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.634203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104b33-a66d-479f-88e8-f76bdbda33b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.634474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da104b33-a66d-479f-88e8-f76bdbda33b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.635152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104b33-a66d-479f-88e8-f76bdbda33b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.636725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da104b33-a66d-479f-88e8-f76bdbda33b0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.641350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.642826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.646935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 800/1598] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.648130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a1c0-ec63-4068-9702-c6b2c486f7f6 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.648529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a1c0-ec63-4068-9702-c6b2c486f7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.652030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e1a1c0-ec63-4068-9702-c6b2c486f7f6 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.652030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 801/1599] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 18:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:25.652030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a1c0-ec63-4068-9702-c6b2c486f7f6 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.652512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 799/1600] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:25.653431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.665886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400cff3c-f615-4caa-a534-376aa14d9ad0 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.668083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e1a1c0-ec63-4068-9702-c6b2c486f7f6 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.672601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.672887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.673229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.673560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.673895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.674013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.674202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.674321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.674847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.675064 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.677351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.677709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.689241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 800/1601] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.696149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 802/1602] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.696292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.696393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.699909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d62033e-2880-46a6-9829-e885c7dde26f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.704706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca33d8-06cc-42b2-b2a2-7cef92414d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.705377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca33d8-06cc-42b2-b2a2-7cef92414d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.705659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca33d8-06cc-42b2-b2a2-7cef92414d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.705969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca33d8-06cc-42b2-b2a2-7cef92414d62 admin admin] PATH_INFO: `/v3/projects/5873902b42054b38958fb189159644c4/users/00b0dda337a146da85e7f62876af2e8b/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.721054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca33d8-06cc-42b2-b2a2-7cef92414d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5873902b42054b38958fb189159644c4, user_id=00b0dda337a146da85e7f62876af2e8b, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.724588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca33d8-06cc-42b2-b2a2-7cef92414d62 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.748296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3107b38-63cc-42a7-93b8-2c5cbd38ccb8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.751948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.752555 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.752829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.753127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.762209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.763641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.765065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.773926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 803/1603] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:25.774794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.785059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb12b16d-aa78-4a0d-ac64-6740090cb537 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.791051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.791730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.792012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.792283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.792965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.794725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.809684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 804/1604] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:25.809684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.820009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621d0953-d888-4967-9022-8e27e67d536c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:25.825543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:25.826256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.826564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.826842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] PATH_INFO: `/v3/projects/1e1ecdf838df4b5780b87c86acc4fe02/users/9297f4c0b9c34321aee707525b2371a8/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.844976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1ecdf838df4b5780b87c86acc4fe02, user_id=9297f4c0b9c34321aee707525b2371a8, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:25.848436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:25.859919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 801/1605] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:25 2022] PUT /identity/v3/projects/5873902b42054b38958fb189159644c4/users/00b0dda337a146da85e7f62876af2e8b/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:25.859919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0935-cecb-407d-87ea-25402ee1b2e3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:25.859919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0935-cecb-407d-87ea-25402ee1b2e3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:25.859919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ae0935-cecb-407d-87ea-25402ee1b2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:25.897301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a5ae0935-cecb-407d-87ea-25402ee1b2e3 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:25.898528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a5ae0935-cecb-407d-87ea-25402ee1b2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:25.919236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:25.940604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 805/1606] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:25 2022] PUT /identity/v3/projects/1e1ecdf838df4b5780b87c86acc4fe02/users/9297f4c0b9c34321aee707525b2371a8/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:25.941435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:25.998850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 802/1607] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 18:24:25 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:25.999575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae0935-cecb-407d-87ea-25402ee1b2e3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.048568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9840578-34db-4c4f-950e-d3fe1b48070e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.056404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.056404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.056404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.056404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] PATH_INFO: `/v3/projects/856b7dde39504ca798827cb9c1b4a4d8/users/5ec59d1b78e24673b23a49d3efdece1b/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.070935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ae0935-cecb-407d-87ea-25402ee1b2e3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.072920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856b7dde39504ca798827cb9c1b4a4d8, user_id=5ec59d1b78e24673b23a49d3efdece1b, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.075861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.076400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b79aa-6ee3-4dcc-ab9f-e89ea67416fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.077031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b79aa-6ee3-4dcc-ab9f-e89ea67416fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.077308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b79aa-6ee3-4dcc-ab9f-e89ea67416fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.077581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b79aa-6ee3-4dcc-ab9f-e89ea67416fb admin admin] PATH_INFO: `/v3/projects/25f1c37d56f540edaef0e575797cad37/users/cf33a185c87843abacdd9e8583d0b716/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.093192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b79aa-6ee3-4dcc-ab9f-e89ea67416fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=25f1c37d56f540edaef0e575797cad37, user_id=cf33a185c87843abacdd9e8583d0b716, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.096043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b79aa-6ee3-4dcc-ab9f-e89ea67416fb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.159104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 806/1608] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:25 2022] PUT /identity/v3/projects/856b7dde39504ca798827cb9c1b4a4d8/users/5ec59d1b78e24673b23a49d3efdece1b/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:26.160044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.189006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 803/1609] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:25 2022] PUT /identity/v3/projects/25f1c37d56f540edaef0e575797cad37/users/cf33a185c87843abacdd9e8583d0b716/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:26.190395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c72ede-2f1f-43f5-b1bd-d5f1998711b0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.190757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c72ede-2f1f-43f5-b1bd-d5f1998711b0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.191036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c72ede-2f1f-43f5-b1bd-d5f1998711b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.227405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a4c72ede-2f1f-43f5-b1bd-d5f1998711b0 None None] MFA Rules not processed for user `00b0dda337a146da85e7f62876af2e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.228535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a4c72ede-2f1f-43f5-b1bd-d5f1998711b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.262705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7deaa0-c13d-4461-b9e9-0205b060be93 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.303710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 804/1610] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:26.305316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21f12-6898-4d3e-bd6f-3d8ce9b21d93 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.305547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21f12-6898-4d3e-bd6f-3d8ce9b21d93 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.305843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad21f12-6898-4d3e-bd6f-3d8ce9b21d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.330965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8ad21f12-6898-4d3e-bd6f-3d8ce9b21d93 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.330965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8ad21f12-6898-4d3e-bd6f-3d8ce9b21d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.351828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.366534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.371516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1f7c1-be00-4fe8-9fbe-e02592228491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.372643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1f7c1-be00-4fe8-9fbe-e02592228491 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.373160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1f7c1-be00-4fe8-9fbe-e02592228491 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.374178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1f7c1-be00-4fe8-9fbe-e02592228491 admin admin] PATH_INFO: `/v3/projects/8475932d464b47c196c387f6c8d3edda/users/c25ffc3341b34fae80a7842c0b0fdbd7/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.399515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1f7c1-be00-4fe8-9fbe-e02592228491 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8475932d464b47c196c387f6c8d3edda, user_id=c25ffc3341b34fae80a7842c0b0fdbd7, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.402434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb1f7c1-be00-4fe8-9fbe-e02592228491 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.410013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 805/1611] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:26.410930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21f12-6898-4d3e-bd6f-3d8ce9b21d93 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.471035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 807/1612] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:26 2022] PUT /identity/v3/projects/8475932d464b47c196c387f6c8d3edda/users/c25ffc3341b34fae80a7842c0b0fdbd7/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:26.475408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2628-5cda-4793-bee0-a8725b44c7fc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.475408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2628-5cda-4793-bee0-a8725b44c7fc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.475408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f2628-5cda-4793-bee0-a8725b44c7fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.485351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad21f12-6898-4d3e-bd6f-3d8ce9b21d93 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.492343 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-098f2628-5cda-4793-bee0-a8725b44c7fc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.497627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-098f2628-5cda-4793-bee0-a8725b44c7fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.560385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 808/1613] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:26.560385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5a49-b23f-4d8a-a61c-237683655aa1 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.560385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5a49-b23f-4d8a-a61c-237683655aa1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.560385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2d5a49-b23f-4d8a-a61c-237683655aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.586757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.587427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.587715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.587979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.588426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-af2d5a49-b23f-4d8a-a61c-237683655aa1 None None] MFA Rules not processed for user `cf33a185c87843abacdd9e8583d0b716`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.589714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-af2d5a49-b23f-4d8a-a61c-237683655aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.658043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.663877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.668954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 809/1614] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:26.670389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5a49-b23f-4d8a-a61c-237683655aa1 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.677847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 806/1615] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:26.679007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.683378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2d5a49-b23f-4d8a-a61c-237683655aa1 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.690301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.696395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.696395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.696395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.696395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.696395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.739915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18c2b-a7dc-4c20-b0ef-0f24659bc18d service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.747929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aa3ed9-4ddd-4530-9b96-b52ac16b8b78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.748559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa3ed9-4ddd-4530-9b96-b52ac16b8b78 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.748842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa3ed9-4ddd-4530-9b96-b52ac16b8b78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.749117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aa3ed9-4ddd-4530-9b96-b52ac16b8b78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.754155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.787135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa3ed9-4ddd-4530-9b96-b52ac16b8b78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:26.788787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aa3ed9-4ddd-4530-9b96-b52ac16b8b78 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:26.811549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 807/1616] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:26.830621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449948f0-db0c-4554-8eba-d418539fb8bc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.830920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449948f0-db0c-4554-8eba-d418539fb8bc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.831205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449948f0-db0c-4554-8eba-d418539fb8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.835408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 810/1617] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:26.839418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:26.903280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-449948f0-db0c-4554-8eba-d418539fb8bc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:26.904980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-449948f0-db0c-4554-8eba-d418539fb8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:26.938832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:26.954098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57efae-a0f7-41f2-879e-caf08821026d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:26.961052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:26.961757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:26.962074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:26.962351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:26.987952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 808/1618] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:26.991087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449948f0-db0c-4554-8eba-d418539fb8bc None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.000098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449948f0-db0c-4554-8eba-d418539fb8bc None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.005347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998cca56-9762-4d3b-820c-9c03e27266f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.005998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cca56-9762-4d3b-820c-9c03e27266f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.006280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cca56-9762-4d3b-820c-9c03e27266f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.006549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998cca56-9762-4d3b-820c-9c03e27266f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.007210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cca56-9762-4d3b-820c-9c03e27266f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.009104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998cca56-9762-4d3b-820c-9c03e27266f4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.045731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.048344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.058928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 811/1619] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:27.059328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.072177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d1a81-17e1-4c32-9c39-780fb56aa40f service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.107714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.107714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.107714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.107714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.108882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.108882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.141917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 809/1620] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:26 2022] POST /identity/v3/projects => generated 403 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:27.143841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ade6-7e40-4311-bf18-25f7de67e39d None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.144247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ade6-7e40-4311-bf18-25f7de67e39d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.144519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a8ade6-7e40-4311-bf18-25f7de67e39d None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.154841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 810/1621] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 18:24:27 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:27.157748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ade6-7e40-4311-bf18-25f7de67e39d None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.157748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-84a8ade6-7e40-4311-bf18-25f7de67e39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:27.216085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 812/1622] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:27 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:27.217115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.235667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb402dd0-4b77-4db8-a321-981135e5bf51 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.245710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a8ade6-7e40-4311-bf18-25f7de67e39d None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.250745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70efc2f-8bd4-492f-9cea-85b056724d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.251383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efc2f-8bd4-492f-9cea-85b056724d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.251678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efc2f-8bd4-492f-9cea-85b056724d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.251980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70efc2f-8bd4-492f-9cea-85b056724d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.333154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.375181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.375181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.375181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.375181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.375611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.376469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.380376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efc2f-8bd4-492f-9cea-85b056724d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.381882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70efc2f-8bd4-492f-9cea-85b056724d99 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.403407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 811/1623] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:27.404734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141227-6358-4b69-b6d6-70ad348dc768 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.405068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141227-6358-4b69-b6d6-70ad348dc768 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.405351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2141227-6358-4b69-b6d6-70ad348dc768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.428926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e2141227-6358-4b69-b6d6-70ad348dc768 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:27.430190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e2141227-6358-4b69-b6d6-70ad348dc768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:27.475011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 813/1624] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:27 2022] POST /identity/v3/users => generated 308 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:27.477951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.497119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23584ea-190c-42e0-a80f-643e591349a2 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.506086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.507798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.508482 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.509105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.511035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.514525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.536154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 814/1625] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:27.537390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.551305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21369ca5-43ce-4079-93c7-d9419649e224 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.557387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.558128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.558477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.558853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.559781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.562175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.563174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 812/1626] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:24:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:27.564307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2141227-6358-4b69-b6d6-70ad348dc768 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.581897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 815/1627] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:27.583176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.607039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2141227-6358-4b69-b6d6-70ad348dc768 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.617413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.618659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.618950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.619222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] PATH_INFO: `/v3/projects/97b92f285b0541d987db849162b5981b/users/75fd01cc30d649f28f46de6a315c16e8/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.636328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b92f285b0541d987db849162b5981b, user_id=75fd01cc30d649f28f46de6a315c16e8, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.639169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.640097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:27.656665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46de294-0d50-4c2c-b61e-f02f7e158dc8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.661337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.667007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.667007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.667007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.676900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.678672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.692458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 816/1628] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:27.693374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.709240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523a9b27-7a9f-4061-9dd1-2e8c63ca9dee service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.717564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.718558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.719063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.719605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] PATH_INFO: `/v3/projects/fe49f536bc5f479ab5c6b17a31e4c975/users/ed58e627392f489ba153c19abc99381b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.739922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe49f536bc5f479ab5c6b17a31e4c975, user_id=ed58e627392f489ba153c19abc99381b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.743396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.762159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 813/1629] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:27 2022] PUT /identity/v3/projects/97b92f285b0541d987db849162b5981b/users/75fd01cc30d649f28f46de6a315c16e8/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:27.763839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.854856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9452685-99ba-4412-b9c3-a80b1228cca3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.862197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.863938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.863938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.864318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.865403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.866882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 817/1630] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:27 2022] PUT /identity/v3/projects/fe49f536bc5f479ab5c6b17a31e4c975/users/ed58e627392f489ba153c19abc99381b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:27.867666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:27.871255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.895728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 814/1631] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:27.909821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:27.934737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0d5fd6-0571-4c93-8c87-d27b3171ebae admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.972358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a955406-edaf-4fe5-a677-9031b276854b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:27.990252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:27.990897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:27.991208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:27.992359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:27.992359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:27.993730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.014777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 818/1632] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:28.018222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.040101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:28.045049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b999d4f4-4473-4cbe-8cfb-0bc610e4f359 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.057219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe9367-60f3-40d1-830a-67eafc192656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.064571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9367-60f3-40d1-830a-67eafc192656 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.064571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9367-60f3-40d1-830a-67eafc192656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.064571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe9367-60f3-40d1-830a-67eafc192656 admin admin] PATH_INFO: `/v3/projects/fe49f536bc5f479ab5c6b17a31e4c975/users/ed58e627392f489ba153c19abc99381b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.064571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe9367-60f3-40d1-830a-67eafc192656 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe49f536bc5f479ab5c6b17a31e4c975, user_id=ed58e627392f489ba153c19abc99381b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.070718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe9367-60f3-40d1-830a-67eafc192656 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.080606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3772edb-8028-411f-936b-16b5eca3a1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.081433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772edb-8028-411f-936b-16b5eca3a1f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.081716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772edb-8028-411f-936b-16b5eca3a1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.082041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3772edb-8028-411f-936b-16b5eca3a1f7 admin admin] PATH_INFO: `/v3/projects/97b92f285b0541d987db849162b5981b/users/75fd01cc30d649f28f46de6a315c16e8/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.086520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3772edb-8028-411f-936b-16b5eca3a1f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97b92f285b0541d987db849162b5981b, user_id=75fd01cc30d649f28f46de6a315c16e8, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.092095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3772edb-8028-411f-936b-16b5eca3a1f7 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.097527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 819/1633] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:28 2022] PUT /identity/v3/projects/fe49f536bc5f479ab5c6b17a31e4c975/users/ed58e627392f489ba153c19abc99381b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:28.118151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23007d-1f86-4875-ae86-cefc7cfce625 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.118647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23007d-1f86-4875-ae86-cefc7cfce625 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.118647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db23007d-1f86-4875-ae86-cefc7cfce625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.123199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 815/1634] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:27 2022] PUT /identity/v3/projects/97b92f285b0541d987db849162b5981b/users/75fd01cc30d649f28f46de6a315c16e8/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:28.133573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42398-ac5f-48ee-9661-eec5af887508 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.133927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42398-ac5f-48ee-9661-eec5af887508 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.134206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f42398-ac5f-48ee-9661-eec5af887508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.187493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-22f42398-ac5f-48ee-9661-eec5af887508 None None] MFA Rules not processed for user `75fd01cc30d649f28f46de6a315c16e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:28.189371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-db23007d-1f86-4875-ae86-cefc7cfce625 None None] MFA Rules not processed for user `ed58e627392f489ba153c19abc99381b`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:28.190437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-22f42398-ac5f-48ee-9661-eec5af887508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:28.193923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-db23007d-1f86-4875-ae86-cefc7cfce625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:28.325046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 816/1635] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:28.352732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f42398-ac5f-48ee-9661-eec5af887508 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.406071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 820/1636] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:28 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:28.456708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f42398-ac5f-48ee-9661-eec5af887508 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.461494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.462223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.462507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.462912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.478550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.481204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.510923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23007d-1f86-4875-ae86-cefc7cfce625 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:28.531720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db23007d-1f86-4875-ae86-cefc7cfce625 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:28.537237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0fbc81-a896-41ed-af7a-af2d0aaee1b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:28.545974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 817/1637] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:28.551304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fbc81-a896-41ed-af7a-af2d0aaee1b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:28.551822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fbc81-a896-41ed-af7a-af2d0aaee1b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:28.552300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0fbc81-a896-41ed-af7a-af2d0aaee1b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:28.565131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fbc81-a896-41ed-af7a-af2d0aaee1b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:28.567034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0fbc81-a896-41ed-af7a-af2d0aaee1b6 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:28.589566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 821/1638] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:28 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:29.086218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:29.239651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d412ae30-1b83-414d-b199-6b5ce10480da service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:29.246266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:29.247066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.247356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.247903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] PATH_INFO: `/v3/users/cf33a185c87843abacdd9e8583d0b716` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.249123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf33a185c87843abacdd9e8583d0b716)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:29.251963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: WARNING py.warnings [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:24:29.251963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: warnings.warn(msg) Jul 27 18:24:29.251963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: Jul 27 18:24:29.253702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:29.304261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bea9f-d4ed-47dc-843c-8354b0c78b47 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.304837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bea9f-d4ed-47dc-843c-8354b0c78b47 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.304837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39bea9f-d4ed-47dc-843c-8354b0c78b47 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.306555 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 822/1639] 10.222.0.67 () {54 vars in 962 bytes} [Wed Jul 27 18:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:29.327396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482276e-d6b8-42df-bd58-bda1a3587c1a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.327818 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482276e-d6b8-42df-bd58-bda1a3587c1a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.328389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d482276e-d6b8-42df-bd58-bda1a3587c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.357407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d482276e-d6b8-42df-bd58-bda1a3587c1a None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:29.359746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d482276e-d6b8-42df-bd58-bda1a3587c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:29.373759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:29.467152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 823/1640] 10.222.0.67 () {58 vars in 1059 bytes} [Wed Jul 27 18:24:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:29.473209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5ced-07c0-46c1-8c0c-bfa731cc81a5 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.479277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5ced-07c0-46c1-8c0c-bfa731cc81a5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.479277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf5ced-07c0-46c1-8c0c-bfa731cc81a5 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.479277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 824/1641] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 18:24:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:24:29.482176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc653e-ddeb-40ac-8fbf-6eedbf7e295f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.482567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc653e-ddeb-40ac-8fbf-6eedbf7e295f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.482963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefc653e-ddeb-40ac-8fbf-6eedbf7e295f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.522858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-aefc653e-ddeb-40ac-8fbf-6eedbf7e295f None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:29.524244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-aefc653e-ddeb-40ac-8fbf-6eedbf7e295f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:29.542698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 825/1642] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:24:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:29.558400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf33a185c87843abacdd9e8583d0b716'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:29.605653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc653e-ddeb-40ac-8fbf-6eedbf7e295f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:29.618043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefc653e-ddeb-40ac-8fbf-6eedbf7e295f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:29.629942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf33a185c87843abacdd9e8583d0b716'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:29.630954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9be7c2-d36b-41a8-98e2-c6c8ab06dabb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:29.633016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9be7c2-d36b-41a8-98e2-c6c8ab06dabb service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.633350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9be7c2-d36b-41a8-98e2-c6c8ab06dabb service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.633631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9be7c2-d36b-41a8-98e2-c6c8ab06dabb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.657087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf33a185c87843abacdd9e8583d0b716'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:29.672111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9be7c2-d36b-41a8-98e2-c6c8ab06dabb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:29.673834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9be7c2-d36b-41a8-98e2-c6c8ab06dabb service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:29.691156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 826/1643] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:24:29.700495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf33a185c87843abacdd9e8583d0b716'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:29.701425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf33a185c87843abacdd9e8583d0b716'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:29.711228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 818/1644] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:29 2022] DELETE /identity/v3/users/cf33a185c87843abacdd9e8583d0b716 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:29.719610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:29.719895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:29.720171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:29.748099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:29.749320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:29.948522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 827/1645] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:29.966441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:29.969183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:30.042408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:30.108289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc0e7-7de9-4530-be48-b8e9b9e9459a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:30.119909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:30.120864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:30.121283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:30.121863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:30.138754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:30.140698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:30.173032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 819/1646] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:31.277393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:31.280545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:31.297918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418f67f-9472-4b7a-bda8-89f27c9b6856 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:31.310609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:31.312371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:31.314823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:31.315510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.315880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.316187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] PATH_INFO: `/v3/users/00b0dda337a146da85e7f62876af2e8b` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.318814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00b0dda337a146da85e7f62876af2e8b)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:31.323990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:31.358958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68679ee4-dd76-4abe-a46e-94faf199f406 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:31.368082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:31.369110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.369594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.370094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] PATH_INFO: `/v3/projects/25f1c37d56f540edaef0e575797cad37` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.371551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=25f1c37d56f540edaef0e575797cad37)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:31.375049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:31.622868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00b0dda337a146da85e7f62876af2e8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.626609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00b0dda337a146da85e7f62876af2e8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.630385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25f1c37d56f540edaef0e575797cad37', 'request_id': 'req-4f468376-5e8f-4120-a7ff-d8488a7599bd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.656997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00b0dda337a146da85e7f62876af2e8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.657874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00b0dda337a146da85e7f62876af2e8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.713337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25f1c37d56f540edaef0e575797cad37', 'request_id': 'req-4f468376-5e8f-4120-a7ff-d8488a7599bd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.721143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25f1c37d56f540edaef0e575797cad37', 'request_id': 'req-4f468376-5e8f-4120-a7ff-d8488a7599bd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.747456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] The token cache is being invalidate because project 25f1c37d56f540edaef0e575797cad37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:31.747961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.755802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.755802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 820/1647] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:31 2022] DELETE /identity/v3/projects/25f1c37d56f540edaef0e575797cad37 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:31.760604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:31.763610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:31.804192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bb913606-4269-4f14-a112-a236f580e05f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00b0dda337a146da85e7f62876af2e8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:31.829895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 828/1648] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:31 2022] DELETE /identity/v3/users/00b0dda337a146da85e7f62876af2e8b => generated 0 bytes in 549 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:31.831481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:31.832346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:31.834512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:31.882891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:31.884876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:31.985257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f468376-5e8f-4120-a7ff-d8488a7599bd admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:32.027014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:32.041533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 829/1649] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:32.054304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:32.056366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:32.168230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:32.168909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:32.169185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:32.169450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] PATH_INFO: `/v3/users/ed58e627392f489ba153c19abc99381b` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:32.183997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed58e627392f489ba153c19abc99381b)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:32.190836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:32.196060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d8605b-21f1-4ac5-9102-582c0a623d55 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:32.212302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:32.212961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:32.213247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:32.213627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:32.261639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:32.264470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:32.284699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 830/1650] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:32.294133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:32.524993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed58e627392f489ba153c19abc99381b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:32.684781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed58e627392f489ba153c19abc99381b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:32.704334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed58e627392f489ba153c19abc99381b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:32.732105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed58e627392f489ba153c19abc99381b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:32.733964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed58e627392f489ba153c19abc99381b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:32.749678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 821/1651] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:31 2022] DELETE /identity/v3/users/ed58e627392f489ba153c19abc99381b => generated 0 bytes in 989 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:33.697593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:33.698923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:33.715889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3a6a87-66f7-429c-975d-0a8ad8fe8c51 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:33.797959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:33.812754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:33.816318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:33.816874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] PATH_INFO: `/v3/projects/5873902b42054b38958fb189159644c4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:33.820590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5873902b42054b38958fb189159644c4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:33.825471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: WARNING py.warnings [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 27 18:24:33.825471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: warnings.warn(msg) Jul 27 18:24:33.825471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: Jul 27 18:24:33.827434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:34.044782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5873902b42054b38958fb189159644c4', 'request_id': 'req-9fb751f4-52fb-41e4-8fe2-2bd71678d531'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.058894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5873902b42054b38958fb189159644c4', 'request_id': 'req-9fb751f4-52fb-41e4-8fe2-2bd71678d531'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.072814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.089679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5873902b42054b38958fb189159644c4', 'request_id': 'req-9fb751f4-52fb-41e4-8fe2-2bd71678d531'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.153817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.173792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:34.175291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02b9154-1199-4f97-919c-45bc589541bd admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:34.241392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] The token cache is being invalidate because project 5873902b42054b38958fb189159644c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:34.250172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.252602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.262282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 831/1652] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:33 2022] DELETE /identity/v3/projects/5873902b42054b38958fb189159644c4 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:34.266694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:34.270723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:34.306751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:34.312138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.312138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.312138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] PATH_INFO: `/v3/projects/fe49f536bc5f479ab5c6b17a31e4c975` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.312138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe49f536bc5f479ab5c6b17a31e4c975)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:34.322220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:34.478821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:34.481434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb751f4-52fb-41e4-8fe2-2bd71678d531 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:34.490904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:34.491582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.491861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.492530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] PATH_INFO: `/v3/users/75fd01cc30d649f28f46de6a315c16e8` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.499106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fd01cc30d649f28f46de6a315c16e8)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:34.501870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:34.605571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe49f536bc5f479ab5c6b17a31e4c975', 'request_id': 'req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.711592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe49f536bc5f479ab5c6b17a31e4c975', 'request_id': 'req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.736772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe49f536bc5f479ab5c6b17a31e4c975', 'request_id': 'req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.784136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] The token cache is being invalidate because project fe49f536bc5f479ab5c6b17a31e4c975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:34.784438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.787270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2d8bf756-f7e5-436a-a9ee-9f99926c48fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.794131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 822/1653] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:34 2022] DELETE /identity/v3/projects/fe49f536bc5f479ab5c6b17a31e4c975 => generated 0 bytes in 638 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:34.798186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29586115-61ae-4fb0-95d0-875a53e88e5e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.798514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29586115-61ae-4fb0-95d0-875a53e88e5e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.799060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29586115-61ae-4fb0-95d0-875a53e88e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:34.828737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fd01cc30d649f28f46de6a315c16e8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.830661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fd01cc30d649f28f46de6a315c16e8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.834847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-29586115-61ae-4fb0-95d0-875a53e88e5e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:34.843305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-29586115-61ae-4fb0-95d0-875a53e88e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:34.855119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fd01cc30d649f28f46de6a315c16e8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.856627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fd01cc30d649f28f46de6a315c16e8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.933576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1dfc3a32-c62c-4e1a-8e96-6f2b851c46dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fd01cc30d649f28f46de6a315c16e8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:34.963022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 832/1654] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:34 2022] DELETE /identity/v3/users/75fd01cc30d649f28f46de6a315c16e8 => generated 0 bytes in 692 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:34.970087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 823/1655] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:34.981041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630c165-6d44-4f5d-b9ce-e2782f0ed021 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:34.981334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630c165-6d44-4f5d-b9ce-e2782f0ed021 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:34.981612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a630c165-6d44-4f5d-b9ce-e2782f0ed021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.024405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a630c165-6d44-4f5d-b9ce-e2782f0ed021 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:35.025641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a630c165-6d44-4f5d-b9ce-e2782f0ed021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:35.195819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29586115-61ae-4fb0-95d0-875a53e88e5e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.211513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 833/1656] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:35.213014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29586115-61ae-4fb0-95d0-875a53e88e5e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.218242 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.219130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.219567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.219993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.221320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:35.221799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.224166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.233286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:35.244477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630c165-6d44-4f5d-b9ce-e2782f0ed021 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.250599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 824/1657] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:35.254504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a630c165-6d44-4f5d-b9ce-e2782f0ed021 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.264391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.265303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.265735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.266208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.267036 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.270274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.435413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 834/1658] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:35 2022] POST /identity/v3/projects => generated 405 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:24:35.439726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.454015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edf8543-74bc-4a8e-94f1-586baa71b37e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.574713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.575545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.575976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.576724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.577865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.580379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.668368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 825/1659] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:35 2022] POST /identity/v3/users => generated 303 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:35.674442 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.687800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cfd70-edbf-42ff-9907-b626c10bde0a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.693879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.695314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.695849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.696282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.697206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.699069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.712086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 835/1660] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:35.715807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.741667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd2de93-4bbd-4b62-b1b5-8648e09dd512 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.750150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e6c42-d48c-46c7-8d4f-f89666f863ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.750893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e6c42-d48c-46c7-8d4f-f89666f863ac admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.754365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e6c42-d48c-46c7-8d4f-f89666f863ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.754674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e6c42-d48c-46c7-8d4f-f89666f863ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.762471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e6c42-d48c-46c7-8d4f-f89666f863ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.766070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e6c42-d48c-46c7-8d4f-f89666f863ac admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.807157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 826/1661] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:35.809305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:35.826139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10aebb43-d0bc-4bef-ab64-9df1b22ab138 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:35.844643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:35.844643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.844643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.844643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] PATH_INFO: `/v3/projects/baffc2f2abb24bae9a95102021dfd5d9/users/eec2694ef5bc4de185607b6eb6b4d012/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:35.886000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=baffc2f2abb24bae9a95102021dfd5d9, user_id=eec2694ef5bc4de185607b6eb6b4d012, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:35.889613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:35.985260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 836/1662] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:35 2022] PUT /identity/v3/projects/baffc2f2abb24bae9a95102021dfd5d9/users/eec2694ef5bc4de185607b6eb6b4d012/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:35.991029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:35.991375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:35.991728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.032411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:36.037728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:36.252090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 827/1663] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:36.258558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:36.368404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:36.370237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:36.511161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adad901-90b5-4e0e-ad64-c4d4ad4beddb admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:36.515129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de34163-da9c-485a-b2de-46c88bb52f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:36.515830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34163-da9c-485a-b2de-46c88bb52f2c service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:36.516046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34163-da9c-485a-b2de-46c88bb52f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:36.516320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de34163-da9c-485a-b2de-46c88bb52f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:36.547899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de34163-da9c-485a-b2de-46c88bb52f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:36.547899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de34163-da9c-485a-b2de-46c88bb52f2c service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:36.575868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 837/1664] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:37.007095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.009345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:37.041175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d393f2-83eb-4f94-a45e-cdfb23849e85 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.061960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.062763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.063166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.063544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] PATH_INFO: `/v3/projects/97b92f285b0541d987db849162b5981b` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.069537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97b92f285b0541d987db849162b5981b)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.073113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.131328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2724df-d7c0-4c47-92aa-1534fa0affa0 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.131883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2724df-d7c0-4c47-92aa-1534fa0affa0 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.131883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2724df-d7c0-4c47-92aa-1534fa0affa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.202138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-cf2724df-d7c0-4c47-92aa-1534fa0affa0 None None] MFA Rules not processed for user `8bbfd4cdd3ba4066ab933f00433c8164`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:37.203419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cf2724df-d7c0-4c47-92aa-1534fa0affa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:37.310454 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97b92f285b0541d987db849162b5981b', 'request_id': 'req-857d1fbb-a858-413e-a6f6-06d462b309c9'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:37.486834 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97b92f285b0541d987db849162b5981b', 'request_id': 'req-857d1fbb-a858-413e-a6f6-06d462b309c9'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:37.491782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 838/1665] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:37.503227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.503227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.503227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.503769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97b92f285b0541d987db849162b5981b', 'request_id': 'req-857d1fbb-a858-413e-a6f6-06d462b309c9'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:37.523617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] The token cache is being invalidate because project 97b92f285b0541d987db849162b5981b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:37.524059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:37.528771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-857d1fbb-a858-413e-a6f6-06d462b309c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:37.548965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 828/1666] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:37 2022] DELETE /identity/v3/projects/97b92f285b0541d987db849162b5981b => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:37.549096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] MFA Rules not processed for user `8bbfd4cdd3ba4066ab933f00433c8164`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:37.549096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:37.553935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f73d1-d4eb-4cc2-bd44-26937cd2ea14 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.554338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f73d1-d4eb-4cc2-bd44-26937cd2ea14 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.554733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825f73d1-d4eb-4cc2-bd44-26937cd2ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.592176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-825f73d1-d4eb-4cc2-bd44-26937cd2ea14 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:37.595802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-825f73d1-d4eb-4cc2-bd44-26937cd2ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:37.604167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:37.683577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 839/1667] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:37.697849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.699411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:37.753618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 829/1668] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:37.754722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261faf6c-c025-4c41-bec3-8b81143a2e56 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.755117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261faf6c-c025-4c41-bec3-8b81143a2e56 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.755493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261faf6c-c025-4c41-bec3-8b81143a2e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.794863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-261faf6c-c025-4c41-bec3-8b81143a2e56 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:37.797646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-261faf6c-c025-4c41-bec3-8b81143a2e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:37.821629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 830/1669] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:37.826502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261faf6c-c025-4c41-bec3-8b81143a2e56 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.837440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261faf6c-c025-4c41-bec3-8b81143a2e56 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.851106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.851571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.852128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.852234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.853001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:37.853313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.855947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.888713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 831/1670] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:37.890071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:37.894769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12322f51-58f1-413d-ba9b-0f466bcec76e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.908901 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.911259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5ab96e-0d29-4850-8c82-e3ec977056b3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:37.912033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.912483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.912867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.916707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:37.929340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:37.931583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:37.931583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:37.931583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:37.931583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.934845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.949484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:37.954850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:37.994993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 840/1671] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:24:38.088268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 832/1672] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:37 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:38.092912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.112009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9935ac44-2313-4cc7-9f9a-c02059d36278 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.274891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.276829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.281149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.286606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.286606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.286606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.400713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 841/1673] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:38 2022] POST /identity/v3/users => generated 282 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:38.405567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:38.407411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.430510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8522468-c7c3-44d5-a508-a9d203db3046 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.445920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.449176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.451532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.451831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.452569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.460382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.485075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 833/1674] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:38.486090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.501692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddb881-2b15-4116-8f5f-43d31c409c17 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.518391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.523332 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.525533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.527098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.531151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.539230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.567466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.569423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 842/1675] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:38.584821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcb638-066d-4fb5-a2d3-42828406ec8b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.616320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a03ec8-54d8-4d1a-865e-c1a085bf2883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.620683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03ec8-54d8-4d1a-865e-c1a085bf2883 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.620683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03ec8-54d8-4d1a-865e-c1a085bf2883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.620683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03ec8-54d8-4d1a-865e-c1a085bf2883 admin admin] PATH_INFO: `/v3/projects/511ef7435b564cdb90ced960cf7058fe/users/8bdea81d58e04e309d18d0db99743db6/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.673380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a03ec8-54d8-4d1a-865e-c1a085bf2883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=511ef7435b564cdb90ced960cf7058fe, user_id=8bdea81d58e04e309d18d0db99743db6, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.676964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a03ec8-54d8-4d1a-865e-c1a085bf2883 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.696661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:38.701092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:38.733947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2b8bc-97c8-4a6c-9028-aa11d31ffa80 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:38.746251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:38.750093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.750380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.750667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] PATH_INFO: `/v3/users/92babc56f5794ed684b4072af4a9c46b` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.756468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92babc56f5794ed684b4072af4a9c46b)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:38.762717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:38.799879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 834/1676] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:38 2022] PUT /identity/v3/projects/511ef7435b564cdb90ced960cf7058fe/users/8bdea81d58e04e309d18d0db99743db6/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:38.812962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d362-7d64-41d2-8ddc-f37956c2bd39 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:38.813473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d362-7d64-41d2-8ddc-f37956c2bd39 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:38.813986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6d362-7d64-41d2-8ddc-f37956c2bd39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:38.878980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-54b6d362-7d64-41d2-8ddc-f37956c2bd39 None None] MFA Rules not processed for user `8bdea81d58e04e309d18d0db99743db6`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:38.880581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-54b6d362-7d64-41d2-8ddc-f37956c2bd39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:38.960777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:38.987340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92babc56f5794ed684b4072af4a9c46b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:38.988582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92babc56f5794ed684b4072af4a9c46b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:39.032663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92babc56f5794ed684b4072af4a9c46b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:39.033684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92babc56f5794ed684b4072af4a9c46b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:39.077323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 835/1677] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:38 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:39.092463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6d362-7d64-41d2-8ddc-f37956c2bd39 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.232674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9561347a-2aea-447d-a402-7d93a86db3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92babc56f5794ed684b4072af4a9c46b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:39.248587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6d362-7d64-41d2-8ddc-f37956c2bd39 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:39.268247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 843/1678] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:38 2022] DELETE /identity/v3/users/92babc56f5794ed684b4072af4a9c46b => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:39.273532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90118cc6-a1e7-416e-821a-a5d21d87c8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:39.274496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118cc6-a1e7-416e-821a-a5d21d87c8d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.275378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f484f75-f44d-4927-b69b-cb21e81fccca None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.276890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f484f75-f44d-4927-b69b-cb21e81fccca None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.277240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118cc6-a1e7-416e-821a-a5d21d87c8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.277672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90118cc6-a1e7-416e-821a-a5d21d87c8d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.279468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f484f75-f44d-4927-b69b-cb21e81fccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.281812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90118cc6-a1e7-416e-821a-a5d21d87c8d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:39.307207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90118cc6-a1e7-416e-821a-a5d21d87c8d3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:39.418625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5f484f75-f44d-4927-b69b-cb21e81fccca None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:39.420821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5f484f75-f44d-4927-b69b-cb21e81fccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:39.526992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 836/1679] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:39 2022] POST /identity/v3/projects => generated 363 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:39.528432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30a08-f732-457b-be21-49f17c79a116 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.533348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30a08-f732-457b-be21-49f17c79a116 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.533348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f30a08-f732-457b-be21-49f17c79a116 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.536685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 837/1680] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 18:24:39 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:39.541108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30a08-f732-457b-be21-49f17c79a116 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.546702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-82f30a08-f732-457b-be21-49f17c79a116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:39.562043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 844/1681] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:39.563886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.564129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.571298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.673975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] MFA Rules not processed for user `052da4ed2e054c70ba8b0bf9b6c5656a`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:39.673975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:39.729479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f30a08-f732-457b-be21-49f17c79a116 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:39.742639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:39.743997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.744428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.744988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.746829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:39.751275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:39.803208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 845/1682] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:24:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:39.804138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.808684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:39.856813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa1492-36ce-4466-833d-ba05bf6c76a7 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:39.872483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:39.873167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.873416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.873696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.898567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 838/1683] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:39 2022] POST /identity/v3/users => generated 288 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:39.903177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.907246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:39.909877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:39.931555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1588-c675-42bd-9d62-53aa5b351fd3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:39.941139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:39.942397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:39.943470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:39.943983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:39.944885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:39.946864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:39.948943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 846/1684] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:39.964277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 839/1685] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:39.966111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:39.984265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1235b6a-e646-447d-ae49-d54f81ee522e service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.017330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:40.019200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.019511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.019792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] PATH_INFO: `/v3/projects/db9bbe2d230b493ebcd7940286d0f674/users/3c43d345af024524a4f2af21870ff090/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.027740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:40.050809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.089296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9bbe2d230b493ebcd7940286d0f674, user_id=3c43d345af024524a4f2af21870ff090, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:40.089424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9c9cb8-bf0d-4b5a-a6d1-a52daf51e9d2 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.091533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:40.106383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:40.107194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.107462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.107797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.132874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:40.134826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:40.154289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 840/1686] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:40.198518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 847/1687] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:39 2022] PUT /identity/v3/projects/db9bbe2d230b493ebcd7940286d0f674/users/3c43d345af024524a4f2af21870ff090/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:40.203770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.221240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f83e4a-d35c-4fba-85ac-a41f5921d17f service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.397950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2becfc18-7aa2-445d-b20d-af93515ef8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:40.398759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becfc18-7aa2-445d-b20d-af93515ef8c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.399153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becfc18-7aa2-445d-b20d-af93515ef8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.399553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2becfc18-7aa2-445d-b20d-af93515ef8c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.400370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becfc18-7aa2-445d-b20d-af93515ef8c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:40.402166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2becfc18-7aa2-445d-b20d-af93515ef8c2 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:40.434175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 841/1688] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:40.435046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.460885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7a62d-a285-4903-9114-4d46204affcb admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.476684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:40.478358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.478813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.479277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] PATH_INFO: `/v3/projects/db9bbe2d230b493ebcd7940286d0f674/users/3c43d345af024524a4f2af21870ff090/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.485102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] RBAC: Authorizing `identity:create_grant(project_id=db9bbe2d230b493ebcd7940286d0f674, user_id=3c43d345af024524a4f2af21870ff090, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:40.494846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:40.524307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 848/1689] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:40 2022] PUT /identity/v3/projects/db9bbe2d230b493ebcd7940286d0f674/users/3c43d345af024524a4f2af21870ff090/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:40.534990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c3bee-847a-4d30-bea0-80d1d3b1adb4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.535442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c3bee-847a-4d30-bea0-80d1d3b1adb4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.535730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3c3bee-847a-4d30-bea0-80d1d3b1adb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.604401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-db3c3bee-847a-4d30-bea0-80d1d3b1adb4 None None] MFA Rules not processed for user `3c43d345af024524a4f2af21870ff090`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:40.606432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-db3c3bee-847a-4d30-bea0-80d1d3b1adb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:40.716959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 842/1690] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:40 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:40.732492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:40.734759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:40.831817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754e27b0-8ec4-480a-91ee-a1111336970d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:40.837497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:40.838942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:40.844032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:40.844032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:40.855597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:40.857744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:40.889251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 849/1691] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:40 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:41.162005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.448808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:41.483920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491324c-d750-4d66-bbe6-f8d619cb3618 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:41.484676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491324c-d750-4d66-bbe6-f8d619cb3618 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:41.485119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7491324c-d750-4d66-bbe6-f8d619cb3618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:41.671749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:41.672195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:41.691347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7491324c-d750-4d66-bbe6-f8d619cb3618 None None] MFA Rules not processed for user `eec2694ef5bc4de185607b6eb6b4d012`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:41.692612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7491324c-d750-4d66-bbe6-f8d619cb3618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:42.030844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 843/1692] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:41 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:42.033017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85275ce-2773-46a8-92fb-70462412c5eb None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.033017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85275ce-2773-46a8-92fb-70462412c5eb None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.033017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85275ce-2773-46a8-92fb-70462412c5eb None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.044011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 844/1693] 10.222.0.67 () {54 vars in 961 bytes} [Wed Jul 27 18:24:42 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:42.045272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85275ce-2773-46a8-92fb-70462412c5eb None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.064372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d85275ce-2773-46a8-92fb-70462412c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:42.095024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d13d6-f24d-47df-bcc5-477ddba0c0a3 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.114975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.123292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.123292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.123292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] PATH_INFO: `/v3/users/7977d8040e744736990407bdec928006` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.123292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7977d8040e744736990407bdec928006)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:42.124203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85275ce-2773-46a8-92fb-70462412c5eb None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.126783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:42.140119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884c902-154c-4b22-a972-3b4a5285c653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:42.140764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884c902-154c-4b22-a972-3b4a5285c653 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.141042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884c902-154c-4b22-a972-3b4a5285c653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.141314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884c902-154c-4b22-a972-3b4a5285c653 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.142256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884c902-154c-4b22-a972-3b4a5285c653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:42.148171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884c902-154c-4b22-a972-3b4a5285c653 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:42.360378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 845/1694] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:42 2022] POST /identity/v3/projects => generated 403 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:42.362463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.363116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.363610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.401405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:42.402721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:42.512800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7977d8040e744736990407bdec928006'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:42.516369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7977d8040e744736990407bdec928006'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:42.568040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7977d8040e744736990407bdec928006'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:42.570035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7977d8040e744736990407bdec928006'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:42.652887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 846/1695] 10.222.0.67 () {58 vars in 1058 bytes} [Wed Jul 27 18:24:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:42.652887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:42.658737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:42.707511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ed075063-9d99-4bb2-a0d7-9c7ee5029889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7977d8040e744736990407bdec928006'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:42.746848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 850/1696] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:41 2022] DELETE /identity/v3/users/7977d8040e744736990407bdec928006 => generated 0 bytes in 1071 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:42.746848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:42.746848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:42.746848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:42.782871 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:42.805222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] MFA Rules not processed for user `8bbfd4cdd3ba4066ab933f00433c8164`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:42.808854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:42.850810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2a7c8c-6a2e-4015-b060-5a4e67978884 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:42.929902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:43.010178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 851/1697] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:43.011385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.013842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:43.072777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.085201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.085201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.085201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.085201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.085201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.163196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c790a1b-efb5-4d39-bfc9-63678e17cd61 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.171056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.172017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.172459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.174187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] PATH_INFO: `/v3/users/8bdea81d58e04e309d18d0db99743db6` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.176421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bdea81d58e04e309d18d0db99743db6)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.179545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.223679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 847/1698] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:42 2022] POST /identity/v3/users => generated 308 bytes in 571 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:43.228155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.336636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a0c99-6849-4017-8c11-d00012481d89 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.341992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bee135-c263-4864-9c5c-6ff98960a8df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.342694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee135-c263-4864-9c5c-6ff98960a8df service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.343039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee135-c263-4864-9c5c-6ff98960a8df service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.343383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bee135-c263-4864-9c5c-6ff98960a8df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.345775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-70bee135-c263-4864-9c5c-6ff98960a8df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:43.365250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee135-c263-4864-9c5c-6ff98960a8df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.365250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bee135-c263-4864-9c5c-6ff98960a8df service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.375953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 848/1699] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:43.377176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.377533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.378443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.398832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:43.400698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:43.410092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 849/1700] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:43.411423 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.420732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:43.435785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c046db6b-9c4e-45e9-8c0d-ec716d353f18 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:43.441471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:43.442690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.443068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.443939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] PATH_INFO: `/v3/projects/448505ebcf1347cf83e47436593bd6aa` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.446328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=448505ebcf1347cf83e47436593bd6aa)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:43.448605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:43.470638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bdea81d58e04e309d18d0db99743db6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.476434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bdea81d58e04e309d18d0db99743db6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.504114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bdea81d58e04e309d18d0db99743db6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.508665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bdea81d58e04e309d18d0db99743db6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.646119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a3f42c40-93a8-4922-9ea3-2fafe824f9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bdea81d58e04e309d18d0db99743db6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.687455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448505ebcf1347cf83e47436593bd6aa', 'request_id': 'req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.691567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 852/1701] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:43 2022] DELETE /identity/v3/users/8bdea81d58e04e309d18d0db99743db6 => generated 0 bytes in 677 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:43.694320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.695471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.695740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.742862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] MFA Rules not processed for user `9297f4c0b9c34321aee707525b2371a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:43.745037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:43.790071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448505ebcf1347cf83e47436593bd6aa', 'request_id': 'req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.798032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448505ebcf1347cf83e47436593bd6aa', 'request_id': 'req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.838849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:43.852988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] The token cache is being invalidate because project 448505ebcf1347cf83e47436593bd6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:43.852988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.852988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d94193c0-bb90-4f39-ba8a-fd41a217e1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:43.855974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 850/1702] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:43 2022] DELETE /identity/v3/projects/448505ebcf1347cf83e47436593bd6aa => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:43.857898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24a44-9c4c-4a28-98a3-739d73fde1b9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:43.858183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24a44-9c4c-4a28-98a3-739d73fde1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:43.858457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24a44-9c4c-4a28-98a3-739d73fde1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:43.900273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 853/1703] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:43.901176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:43.911152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:43.927953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bac24a44-9c4c-4a28-98a3-739d73fde1b9 None None] MFA Rules not processed for user `5ec59d1b78e24673b23a49d3efdece1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:43.930971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bac24a44-9c4c-4a28-98a3-739d73fde1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.017886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc642b-5bd7-4675-b266-6b54e19be4c5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.027075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.027964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.028503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.028975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.029865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:44.031734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:44.049631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 854/1704] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:44.050892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.054486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.058380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 851/1705] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:44.059777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84a7d-22c7-4bc0-8c8c-ce6ceb4c2dbd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.060123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84a7d-22c7-4bc0-8c8c-ce6ceb4c2dbd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.060399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc84a7d-22c7-4bc0-8c8c-ce6ceb4c2dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.093088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-4bc84a7d-22c7-4bc0-8c8c-ce6ceb4c2dbd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:44.094990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4bc84a7d-22c7-4bc0-8c8c-ce6ceb4c2dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.131668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 852/1706] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:44.131668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.131668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.131668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.167501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:44.168999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.185023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 853/1707] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:44.185023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.189057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.208030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ee87f-ef3e-4837-855a-db899918308b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.227352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.227352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.227352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.227352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.228224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.231693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:44.233702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:44.249091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 855/1708] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:44.250014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.264846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b365e4-6ebf-4eff-8e24-4c51e5797e5e service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.272005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7cbd7b-1732-484a-96a9-e03d8c42425a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.272747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cbd7b-1732-484a-96a9-e03d8c42425a admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.273034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cbd7b-1732-484a-96a9-e03d8c42425a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.273360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7cbd7b-1732-484a-96a9-e03d8c42425a admin admin] PATH_INFO: `/v3/projects/7e8bfb6662ed41958a31bb599b2d2292/users/5de2728af17041e8b2717d2549a72ffe/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.291712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cbd7b-1732-484a-96a9-e03d8c42425a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8bfb6662ed41958a31bb599b2d2292, user_id=5de2728af17041e8b2717d2549a72ffe, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:44.294675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7cbd7b-1732-484a-96a9-e03d8c42425a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:44.321229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5492f5-be54-40e8-9a5e-671e76220aed None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.347249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bf76-40b2-42d8-99cc-b573ce1b5cb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.347978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf76-40b2-42d8-99cc-b573ce1b5cb7 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.348354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf76-40b2-42d8-99cc-b573ce1b5cb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.349061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bf76-40b2-42d8-99cc-b573ce1b5cb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.371452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207bf76-40b2-42d8-99cc-b573ce1b5cb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:44.383903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 856/1709] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:44 2022] PUT /identity/v3/projects/7e8bfb6662ed41958a31bb599b2d2292/users/5de2728af17041e8b2717d2549a72ffe/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:44.386024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac151f-08d4-4e86-a173-68fb81f1fb21 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.386024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac151f-08d4-4e86-a173-68fb81f1fb21 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.386024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcac151f-08d4-4e86-a173-68fb81f1fb21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.390064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207bf76-40b2-42d8-99cc-b573ce1b5cb7 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:44.426814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-fcac151f-08d4-4e86-a173-68fb81f1fb21 None None] MFA Rules not processed for user `5ec59d1b78e24673b23a49d3efdece1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:44.429504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:44.431053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-fcac151f-08d4-4e86-a173-68fb81f1fb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.432069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 854/1710] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:44.435201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0109-eb76-450f-ba7f-64af83583c5b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.436761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0109-eb76-450f-ba7f-64af83583c5b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.437238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f0109-eb76-450f-ba7f-64af83583c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.507903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-196f0109-eb76-450f-ba7f-64af83583c5b None None] MFA Rules not processed for user `c25ffc3341b34fae80a7842c0b0fdbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:44.510237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-196f0109-eb76-450f-ba7f-64af83583c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.526037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 857/1711] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:44.532504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac151f-08d4-4e86-a173-68fb81f1fb21 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.672310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcac151f-08d4-4e86-a173-68fb81f1fb21 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.676995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.677574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 855/1712] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:44.679153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6935-7f9e-4a3e-abaa-d1ea7a04a23b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.682275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6935-7f9e-4a3e-abaa-d1ea7a04a23b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.682275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa6935-7f9e-4a3e-abaa-d1ea7a04a23b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.689874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.690197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.691057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.713351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-86aa6935-7f9e-4a3e-abaa-d1ea7a04a23b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:44.714630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-86aa6935-7f9e-4a3e-abaa-d1ea7a04a23b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.886909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 856/1713] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:44.890712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa6935-7f9e-4a3e-abaa-d1ea7a04a23b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.926975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa6935-7f9e-4a3e-abaa-d1ea7a04a23b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:44.936350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:44.936350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:44.941140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:44.941722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:44.941986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:44.942281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:44.942999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:44.944606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:44.962042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 858/1714] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:44.964772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:44.974629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:44.986801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 857/1715] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:44.989024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.190700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc02628-d70e-4b7b-adc3-e2f5ea4dde54 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.195014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91006822-5698-469b-9b67-df340e6d1f7e service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.207682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.210424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.210424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.211191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.216915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.218516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.220032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.220731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.225928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.228060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.248310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.251276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.276231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 859/1716] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:45.276654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 858/1717] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:45.281160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.297265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.306100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66b4bbe-3bd3-4f97-b8aa-4763a6f8e4c6 service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.312031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.312783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.313067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.313678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] PATH_INFO: `/v3/projects/7e8bfb6662ed41958a31bb599b2d2292/users/5de2728af17041e8b2717d2549a72ffe/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.316148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e8bfb6662ed41958a31bb599b2d2292, user_id=5de2728af17041e8b2717d2549a72ffe, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.319085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.335338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 859/1718] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:45 2022] PUT /identity/v3/projects/7e8bfb6662ed41958a31bb599b2d2292/users/5de2728af17041e8b2717d2549a72ffe/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:45.336207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.348669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1511a68c-79a2-44e7-9126-cb7fb5d9ee3c service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.360744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:45.538490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.540771 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.541107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.541376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.542116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:45.542427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.544051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.560383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b65221-9887-4d66-ac4a-5d0fa17544da admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.577083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.578718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.578966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.580015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] PATH_INFO: `/v3/projects/2aaa747afc8c49128639f395778c644e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.580526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aaa747afc8c49128639f395778c644e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.582654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 860/1719] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:45.584038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.587379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.600458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4599-136c-444d-b077-5b4413ff2f31 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.606914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.607784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.608232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.608650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.609528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.611958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.758306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 861/1720] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:45 2022] POST /identity/v3/projects => generated 373 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:45.764470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:45.795187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aaa747afc8c49128639f395778c644e', 'request_id': 'req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:45.927324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aaa747afc8c49128639f395778c644e', 'request_id': 'req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:45.954120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aaa747afc8c49128639f395778c644e', 'request_id': 'req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:45.966962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17b0030-de77-409f-ba0e-2d2e96dd2c18 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:45.972666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] The token cache is being invalidate because project 2aaa747afc8c49128639f395778c644e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:45.974049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:45.975072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-afbcb9fc-9ffd-4e31-a4b9-73b92e9cf8a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:45.978148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 860/1721] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:45 2022] DELETE /identity/v3/projects/2aaa747afc8c49128639f395778c644e => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:45.993597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:45.993597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.993597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.993597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:45.993979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:45.994063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf1c4d-489a-492d-92a7-75f9ba25b249 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:45.994063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf1c4d-489a-492d-92a7-75f9ba25b249 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:45.994207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:45.994715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbf1c4d-489a-492d-92a7-75f9ba25b249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.042374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8cbf1c4d-489a-492d-92a7-75f9ba25b249 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:46.058297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=2,keystone:SELECT=98 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:46.059735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8cbf1c4d-489a-492d-92a7-75f9ba25b249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:46.075472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 861/1722] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:46.083489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ff2a-f621-4ade-abf1-d69ddb1deee6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.084056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ff2a-f621-4ade-abf1-d69ddb1deee6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.084760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ff2a-f621-4ade-abf1-d69ddb1deee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.123499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-adf7ff2a-f621-4ade-abf1-d69ddb1deee6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:46.125080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-adf7ff2a-f621-4ade-abf1-d69ddb1deee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:46.135577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 862/1723] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:45 2022] POST /identity/v3/users => generated 287 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:46.136781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.144338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 862/1724] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:46.145596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:46.145848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ff2a-f621-4ade-abf1-d69ddb1deee6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.179375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ff2a-f621-4ade-abf1-d69ddb1deee6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.185138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5028430-75cf-4042-8ff9-aed934b1f252 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.192418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.195891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.195891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.195891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.196867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:46.197266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.202512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.217326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.222171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.222171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.222171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.222171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.224116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.236258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 863/1725] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:24:46.240454 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.262308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 863/1726] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:46.263476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93d243e-1f6b-4621-bfe8-2baf3af2db7f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.266330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.290237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd629fa-5747-43fd-8d90-1ac1bdb9d852 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.293904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.294705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.295074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.296337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.298424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.301977 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.310922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.312435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.312435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.312435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.328693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.334515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.364433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 864/1727] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:46.366091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.384172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c040dfd-b730-4405-b459-a94c9c845f72 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.405105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.405864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.406149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.414655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] PATH_INFO: `/v3/projects/f34cd424e6c54a8eb6aaba4cc1403fc3/users/a6bfd43046f84cdfb670f642d1275e76/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.448746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34cd424e6c54a8eb6aaba4cc1403fc3, user_id=a6bfd43046f84cdfb670f642d1275e76, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.451295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.468580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 864/1728] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:46 2022] POST /identity/v3/projects => generated 355 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:46.470745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.477658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:46.557366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 865/1729] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:46 2022] PUT /identity/v3/projects/f34cd424e6c54a8eb6aaba4cc1403fc3/users/a6bfd43046f84cdfb670f642d1275e76/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:46.559037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:46.773335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13259688-fab2-4960-85c7-43f61e5f2703 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.861931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aafba8-fccc-4bb9-8b7f-8c175e62fecf admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:46.882985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.883640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba5a7ee-3a15-4b1e-8f59-286954de836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:46.884063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.884458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.884917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] PATH_INFO: `/v3/projects/511ef7435b564cdb90ced960cf7058fe` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.885325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a7ee-3a15-4b1e-8f59-286954de836e admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:46.885586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:46.886140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a7ee-3a15-4b1e-8f59-286954de836e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:46.886427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba5a7ee-3a15-4b1e-8f59-286954de836e admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:46.886817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=511ef7435b564cdb90ced960cf7058fe)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.887098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a7ee-3a15-4b1e-8f59-286954de836e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:46.889189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:46.889863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba5a7ee-3a15-4b1e-8f59-286954de836e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.010734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 866/1730] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:46 2022] POST /identity/v3/users => generated 278 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:47.015242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.015636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.016018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.046349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '511ef7435b564cdb90ced960cf7058fe', 'request_id': 'req-e092ea84-c5ee-47f8-bbea-e816a7b602b0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.086102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] MFA Rules not processed for user `a6bfd43046f84cdfb670f642d1275e76`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:47.089576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:47.153326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '511ef7435b564cdb90ced960cf7058fe', 'request_id': 'req-e092ea84-c5ee-47f8-bbea-e816a7b602b0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.173586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '511ef7435b564cdb90ced960cf7058fe', 'request_id': 'req-e092ea84-c5ee-47f8-bbea-e816a7b602b0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.226289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] The token cache is being invalidate because project 511ef7435b564cdb90ced960cf7058fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:47.226735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.227642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.233426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 865/1731] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:46 2022] DELETE /identity/v3/projects/511ef7435b564cdb90ced960cf7058fe => generated 0 bytes in 761 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:47.234688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.236896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:47.282907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 867/1732] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:47.284974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.288599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:47.411166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:47.439187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092ea84-c5ee-47f8-bbea-e816a7b602b0 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.459556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5d2883-7f2e-47de-9e02-73ce259a285e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.464776 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.465558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.465958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.466324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.468119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.473928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.485505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.485505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.485505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.486080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] PATH_INFO: `/v3/users/3c43d345af024524a4f2af21870ff090` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.492977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c43d345af024524a4f2af21870ff090)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.496971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.525411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 866/1733] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:47.533741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.545048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:47.697389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e996cea3-bf34-4d7c-b683-ac3a7dc3e118 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.699343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.700033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.700317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.700646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.712356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.714499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.733960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 867/1734] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:47.735053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.748040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763a3ed-0bf0-4319-aadd-dc4fa03e85ae service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.763950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.775404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.775920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.776966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:47.778004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:47.779930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:47.862630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 868/1735] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:47 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:47.872761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c43d345af024524a4f2af21870ff090'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.881147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:47.881376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c43d345af024524a4f2af21870ff090'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.933634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3def-33f7-4cae-ba64-60466cf64116 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:47.941001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c43d345af024524a4f2af21870ff090'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.945651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c43d345af024524a4f2af21870ff090'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:47.973004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:47.975811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:47.975811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:47.977849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] PATH_INFO: `/v3/projects/519fa53cd3a642b8bc8fd5e3f424de52/users/9d6b4ae300a045e280f84362c572acf4/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.026504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=519fa53cd3a642b8bc8fd5e3f424de52, user_id=9d6b4ae300a045e280f84362c572acf4, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.034911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.070081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b2f612a1-5085-4248-9614-0499e87ff3be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c43d345af024524a4f2af21870ff090'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:48.091556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 868/1736] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:47 2022] DELETE /identity/v3/users/3c43d345af024524a4f2af21870ff090 => generated 0 bytes in 808 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:48.145503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 869/1737] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:47 2022] PUT /identity/v3/projects/519fa53cd3a642b8bc8fd5e3f424de52/users/9d6b4ae300a045e280f84362c572acf4/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:48.157889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.158523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.160035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.249640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:48.251468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:48.264156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] MFA Rules not processed for user `9d6b4ae300a045e280f84362c572acf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:48.269972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:48.416956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f373f-0b9d-4e50-a72b-9621b10becc1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:48.432857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:48.433645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.434361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.434657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] PATH_INFO: `/v3/users/a6bfd43046f84cdfb670f642d1275e76` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.437525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6bfd43046f84cdfb670f642d1275e76)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.439852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.532656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:48.574169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 869/1738] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:48 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:48.577082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:48.587864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:48.655071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029ed9d2-af78-4311-ad46-ae5b3f1e6d36 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:48.669578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde5c4a4-a64c-4b93-8241-3a30f756620c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:48.670329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c4a4-a64c-4b93-8241-3a30f756620c admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.670885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c4a4-a64c-4b93-8241-3a30f756620c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.671790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde5c4a4-a64c-4b93-8241-3a30f756620c admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.672522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5c4a4-a64c-4b93-8241-3a30f756620c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:48.678593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde5c4a4-a64c-4b93-8241-3a30f756620c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:48.786291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6bfd43046f84cdfb670f642d1275e76'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:48.842928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 870/1739] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:48 2022] POST /identity/v3/projects => generated 353 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:48.845634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc5cf-76f6-4f51-822b-319c625883f4 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:48.847133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc5cf-76f6-4f51-822b-319c625883f4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:48.848891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92bc5cf-76f6-4f51-822b-319c625883f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:48.912745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6bfd43046f84cdfb670f642d1275e76'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:48.922529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6bfd43046f84cdfb670f642d1275e76'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:48.957425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6bfd43046f84cdfb670f642d1275e76'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:48.959996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6bfd43046f84cdfb670f642d1275e76'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:48.976899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 870/1740] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:24:48 2022] DELETE /identity/v3/users/a6bfd43046f84cdfb670f642d1275e76 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:48.978106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:48.982971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:49.022125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d92bc5cf-76f6-4f51-822b-319c625883f4 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:49.023352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d92bc5cf-76f6-4f51-822b-319c625883f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:49.154444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e346d1-c49d-40ad-adf8-3618cacf56ff admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:49.169537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:49.170144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.170476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.170874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.176697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:49.177483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:49.221954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:49.240462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 871/1741] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:24:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:49.241957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319592-9be7-48c2-943a-18cd178bfd54 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.242241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319592-9be7-48c2-943a-18cd178bfd54 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.242680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2319592-9be7-48c2-943a-18cd178bfd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.278665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:49.286672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 871/1742] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:48 2022] POST /identity/v3/users => generated 283 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:49.291764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:49.333220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-f2319592-9be7-48c2-943a-18cd178bfd54 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:49.338452 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f2319592-9be7-48c2-943a-18cd178bfd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:49.352802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d31f1-898e-443d-ad68-36df1a8edd17 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:49.370757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 872/1743] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:49.371473 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:49.372272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.373255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.375736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.382028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:49.385750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:49.416960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 872/1744] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:49.422324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319592-9be7-48c2-943a-18cd178bfd54 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:49.437492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2319592-9be7-48c2-943a-18cd178bfd54 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:49.444809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:49.446174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.446614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.451921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] PATH_INFO: `/v3/projects/a04bc9cc17a94703bf9965c99b42c184/users/845658c501bb433e9f67e8ad5a60f1a5/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.467182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:49.469389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:49.502923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bc9cc17a94703bf9965c99b42c184, user_id=845658c501bb433e9f67e8ad5a60f1a5, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:49.513815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:49.590335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a7b5ce-53db-4b27-91ab-2ab9c9bec4a3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:49.596051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:49.597115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.597464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.597862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.611741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:49.614859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:49.628809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 873/1745] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:49.698892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 873/1746] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:49 2022] PUT /identity/v3/projects/a04bc9cc17a94703bf9965c99b42c184/users/845658c501bb433e9f67e8ad5a60f1a5/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:49.702950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:49.722376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaa0b8-2fcb-47c2-b01c-85e7b025b106 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:49.725314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:49.728310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:49.925723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:49.926399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.926679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.926951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.927678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:49.929319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:49.955419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9121c97f-1c2d-4e8e-b643-4b400e5e86df admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:49.965563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 874/1747] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:24:49.969657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:49.979959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:49.979959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:49.979959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:49.979959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:49.997492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a3eeb-7d3d-49bf-8938-f812dc230d4d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.011870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a9f52-efcd-434d-8644-ae7166733beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.012570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9f52-efcd-434d-8644-ae7166733beb admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.012859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9f52-efcd-434d-8644-ae7166733beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.013126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a9f52-efcd-434d-8644-ae7166733beb admin admin] PATH_INFO: `/v3/projects/a04bc9cc17a94703bf9965c99b42c184/users/845658c501bb433e9f67e8ad5a60f1a5/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.020095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a9f52-efcd-434d-8644-ae7166733beb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a04bc9cc17a94703bf9965c99b42c184, user_id=845658c501bb433e9f67e8ad5a60f1a5, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.023040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a9f52-efcd-434d-8644-ae7166733beb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.052116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 875/1748] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:49 2022] PUT /identity/v3/projects/a04bc9cc17a94703bf9965c99b42c184/users/845658c501bb433e9f67e8ad5a60f1a5/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:50.062694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831fdf-1eb3-4662-ae98-0996e9a89fe1 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.062986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831fdf-1eb3-4662-ae98-0996e9a89fe1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.063262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831fdf-1eb3-4662-ae98-0996e9a89fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.155785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7c831fdf-1eb3-4662-ae98-0996e9a89fe1 None None] MFA Rules not processed for user `845658c501bb433e9f67e8ad5a60f1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:50.157152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7c831fdf-1eb3-4662-ae98-0996e9a89fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.198062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.199622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.230725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 874/1749] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:24:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 506 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:24:50.231919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.237985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.290274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e031b7-1755-4c52-b65f-c0077ca23d67 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.450046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.450647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.450926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.451205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] PATH_INFO: `/v3/projects/db9bbe2d230b493ebcd7940286d0f674` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.458719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db9bbe2d230b493ebcd7940286d0f674)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:50.460729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:50.492522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 876/1750] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:50 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:50.497191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c6278-a90b-426f-b55c-7cb8cb0cb38c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.497547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c6278-a90b-426f-b55c-7cb8cb0cb38c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.497887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2c6278-a90b-426f-b55c-7cb8cb0cb38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.626205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-1e2c6278-a90b-426f-b55c-7cb8cb0cb38c None None] MFA Rules not processed for user `5de2728af17041e8b2717d2549a72ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:50.628198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1e2c6278-a90b-426f-b55c-7cb8cb0cb38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.698654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db9bbe2d230b493ebcd7940286d0f674', 'request_id': 'req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:50.706249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db9bbe2d230b493ebcd7940286d0f674', 'request_id': 'req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:50.727279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db9bbe2d230b493ebcd7940286d0f674', 'request_id': 'req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:50.764394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:50.796747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] The token cache is being invalidate because project db9bbe2d230b493ebcd7940286d0f674 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:50.797058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:50.801187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:50.803699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 875/1751] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:50 2022] DELETE /identity/v3/projects/db9bbe2d230b493ebcd7940286d0f674 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:50.807746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:50.812398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.897877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 877/1752] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:50.900172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dcec5-857f-4edf-8b56-bbe068507d68 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.900622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dcec5-857f-4edf-8b56-bbe068507d68 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.901039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743dcec5-857f-4edf-8b56-bbe068507d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:50.951624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-743dcec5-857f-4edf-8b56-bbe068507d68 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:50.953195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-743dcec5-857f-4edf-8b56-bbe068507d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:50.990252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9ea35-0ac3-4cd6-8c4c-d00203a5c1a3 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:50.997340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:50.998177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:50.999175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:50.999629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.002534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:51.099042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 878/1753] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:51.107122 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84da5-d7e5-4a08-a449-b7a8a5423ae1 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.107632 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84da5-d7e5-4a08-a449-b7a8a5423ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.108038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a84da5-d7e5-4a08-a449-b7a8a5423ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.121168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.127388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.155069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e7a84da5-d7e5-4a08-a449-b7a8a5423ae1 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:51.156586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e7a84da5-d7e5-4a08-a449-b7a8a5423ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:51.168424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 876/1754] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:50 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:51.180519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 879/1755] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:51.188360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.209705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:51.210919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b652ca5-7f1b-484c-9422-795180041db7 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.228877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.229640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.230012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.230261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.231010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:51.231317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.233134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.285217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84da5-d7e5-4a08-a449-b7a8a5423ae1 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.285937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 877/1756] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:51.316058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a84da5-d7e5-4a08-a449-b7a8a5423ae1 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.349899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.351187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.351483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.351794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.352461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.364708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.480059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.507647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e514c691-9dd1-4a90-b96b-4451e7fde7a0 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.526128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.531481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.533094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.534340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.538257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 880/1757] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:51 2022] POST /identity/v3/projects => generated 369 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:51.540272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:51.551887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.765855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0d85f-ed16-4568-9649-9c41eb16f0c1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.791151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.791720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.792086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.792367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.793133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.798027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.821747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.834194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:51.849441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 878/1758] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:51 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:24:51.851456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:51.854686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:51.933401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a06799d-35a4-4469-9d1a-32e5ae85c88d service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:51.948355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:51.949632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:51.950471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:51.958265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] PATH_INFO: `/v3/projects/f34cd424e6c54a8eb6aaba4cc1403fc3` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:51.973901 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34cd424e6c54a8eb6aaba4cc1403fc3)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:51.994855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.137059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 881/1759] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:51 2022] POST /identity/v3/users => generated 285 bytes in 586 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:24:52.142566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:52.165842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34cd424e6c54a8eb6aaba4cc1403fc3', 'request_id': 'req-48396bb4-3c91-4b3f-9b13-47272a6bb307'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:52.184737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbd599f-2dd5-4522-b1b9-756ffd5e1b86 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:52.186171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34cd424e6c54a8eb6aaba4cc1403fc3', 'request_id': 'req-48396bb4-3c91-4b3f-9b13-47272a6bb307'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:52.207943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34cd424e6c54a8eb6aaba4cc1403fc3', 'request_id': 'req-48396bb4-3c91-4b3f-9b13-47272a6bb307'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:52.342089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:52.342738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.343017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.343291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.344059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:52.358998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.386077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] The token cache is being invalidate because project f34cd424e6c54a8eb6aaba4cc1403fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:24:52.389459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 882/1760] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:24:52.389578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:52.389578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-48396bb4-3c91-4b3f-9b13-47272a6bb307 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:24:52.390735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:52.393287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:52.394567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 879/1761] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:24:51 2022] DELETE /identity/v3/projects/f34cd424e6c54a8eb6aaba4cc1403fc3 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:52.398273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49d7d-ec14-425a-a257-c68514c3916c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.398273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49d7d-ec14-425a-a257-c68514c3916c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.398761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b49d7d-ec14-425a-a257-c68514c3916c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.436980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a3b49d7d-ec14-425a-a257-c68514c3916c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:52.439629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a3b49d7d-ec14-425a-a257-c68514c3916c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:52.442074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bf80a-72ec-4618-964a-b18de25783ab admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:52.459721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:52.460369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.460652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.460932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.461630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:52.463367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.471929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 880/1762] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:52.476447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c28d-43ff-4494-bc30-80fb3b0f377e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.477475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c28d-43ff-4494-bc30-80fb3b0f377e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.478543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6c28d-43ff-4494-bc30-80fb3b0f377e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.497836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 883/1763] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:52.500457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:52.539747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58d00e-a439-47ae-9dbf-b4f3b25c3425 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:52.565990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e1f6c28d-43ff-4494-bc30-80fb3b0f377e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:52.565990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e1f6c28d-43ff-4494-bc30-80fb3b0f377e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:52.584845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6937671d-0ac9-4be4-b60d-c21fdedd3bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:52.588503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937671d-0ac9-4be4-b60d-c21fdedd3bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.592034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937671d-0ac9-4be4-b60d-c21fdedd3bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.592959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6937671d-0ac9-4be4-b60d-c21fdedd3bde admin admin] PATH_INFO: `/v3/projects/76a945bf22014b3882455e0c8c081686/users/4c9453e773414a0b84b929453b9e3b2d/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.600255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 881/1764] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:52.602602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6c28d-43ff-4494-bc30-80fb3b0f377e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:52.625516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6c28d-43ff-4494-bc30-80fb3b0f377e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:52.645517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:52.646624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.647326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.647847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.649117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:24:52.649878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:52.652006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.683697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 882/1765] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:24:52.690871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:52.704579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937671d-0ac9-4be4-b60d-c21fdedd3bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=76a945bf22014b3882455e0c8c081686, user_id=4c9453e773414a0b84b929453b9e3b2d, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:52.715245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6937671d-0ac9-4be4-b60d-c21fdedd3bde admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.733329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bccd6b9-0f9b-4c72-aefb-62f1d1a1ecf8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:52.748872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:52.749521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.751436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.751705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.752455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:52.754977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:52.842450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 884/1766] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:52 2022] PUT /identity/v3/projects/76a945bf22014b3882455e0c8c081686/users/4c9453e773414a0b84b929453b9e3b2d/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:52.857172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1c46-8d6a-41a9-9227-cee30399d563 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:52.857352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1c46-8d6a-41a9-9227-cee30399d563 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:52.857918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2df1c46-8d6a-41a9-9227-cee30399d563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:52.920898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c2df1c46-8d6a-41a9-9227-cee30399d563 None None] MFA Rules not processed for user `4c9453e773414a0b84b929453b9e3b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:52.923144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c2df1c46-8d6a-41a9-9227-cee30399d563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:52.932471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 883/1767] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:52 2022] POST /identity/v3/projects => generated 391 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:52.935777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.026603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:53.108941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25642e6-223a-4d90-b3ac-0fbeadc0fb82 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.123073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.123727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.124005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.124277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.124955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.128068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.160004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 885/1768] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:52 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:53.164332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1c46-8d6a-41a9-9227-cee30399d563 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.259694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 884/1769] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:52 2022] POST /identity/v3/users => generated 296 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:53.264467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.295942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abd6657-29f7-4e81-9d5b-618674fe2207 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.316691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.317344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.317637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.317927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.325021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.326753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.371181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2df1c46-8d6a-41a9-9227-cee30399d563 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.378821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 885/1770] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:53.379940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.395914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.396564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.396847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.400528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.403850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.406653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.415140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91eb31-251c-46c7-a12e-36e328d838bd admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.435996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.438072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.438072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.438072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.446238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.452349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.495303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 886/1771] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:53.501301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.527117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:53.545535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba2e247-974d-4bef-8358-54821fb9a412 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.559019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab4af-368b-4abc-b0f1-beb6c43b8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:53.563414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab4af-368b-4abc-b0f1-beb6c43b8bf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.563414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab4af-368b-4abc-b0f1-beb6c43b8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.563414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab4af-368b-4abc-b0f1-beb6c43b8bf8 admin admin] PATH_INFO: `/v3/projects/f646429fb4f84dd5a2c4efbf27da9ba2/users/d63a2591a753478385f29dbefc6bf2cb/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.590539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 886/1772] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:53 2022] POST /identity/v3/projects => generated 369 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:24:53.595213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:53.620516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab4af-368b-4abc-b0f1-beb6c43b8bf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f646429fb4f84dd5a2c4efbf27da9ba2, user_id=d63a2591a753478385f29dbefc6bf2cb, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:53.640826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab4af-368b-4abc-b0f1-beb6c43b8bf8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:53.756309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 887/1773] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:53 2022] PUT /identity/v3/projects/f646429fb4f84dd5a2c4efbf27da9ba2/users/d63a2591a753478385f29dbefc6bf2cb/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:53.757882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553c27d-7f95-42f6-8437-62ecf49f92b6 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:53.759548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553c27d-7f95-42f6-8437-62ecf49f92b6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:53.759736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5553c27d-7f95-42f6-8437-62ecf49f92b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:53.850181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ccaf6-5973-49e3-8707-21786f698d1f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:53.882568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5553c27d-7f95-42f6-8437-62ecf49f92b6 None None] MFA Rules not processed for user `d63a2591a753478385f29dbefc6bf2cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:53.888913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5553c27d-7f95-42f6-8437-62ecf49f92b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:54.083136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.088392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.088392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.088392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.088392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.090821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.127399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 888/1774] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 370 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:54.128935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75bec4-4d1d-4eef-b159-5fcb08898408 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.129229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75bec4-4d1d-4eef-b159-5fcb08898408 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.129512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b75bec4-4d1d-4eef-b159-5fcb08898408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.163587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9b75bec4-4d1d-4eef-b159-5fcb08898408 None None] MFA Rules not processed for user `9297f4c0b9c34321aee707525b2371a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:54.164876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9b75bec4-4d1d-4eef-b159-5fcb08898408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:54.270982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 887/1775] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:53 2022] POST /identity/v3/users => generated 291 bytes in 676 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:54.271983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.301344 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfce9dd-f262-47e0-847f-e1d2aa1efbce admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.312383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 889/1776] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:54.313642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75bec4-4d1d-4eef-b159-5fcb08898408 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.335465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.336109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.336400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.336674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.338232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.350557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.351951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b75bec4-4d1d-4eef-b159-5fcb08898408 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.372322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.373039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.373324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.373603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.374612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.381462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.425254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 890/1777] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:54.433980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.470914 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6ea51-a3d8-40fb-9bed-3ec6dcfe0f9d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.494720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.495627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.496204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.496641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] PATH_INFO: `/v3/projects/2a707c964d3046b5bc5690a3e2836387/users/6e394c71724b4d33863dfe87f70f174b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.533337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a707c964d3046b5bc5690a3e2836387, user_id=6e394c71724b4d33863dfe87f70f174b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.536957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.595109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 888/1778] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:24:54 2022] POST /identity/v3/projects => generated 393 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:24:54.600243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.696926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 891/1779] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:54 2022] PUT /identity/v3/projects/2a707c964d3046b5bc5690a3e2836387/users/6e394c71724b4d33863dfe87f70f174b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:54.702840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.760901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d631c-f8e4-4a5c-92f8-8ce28940b772 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.893706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90cc8d4-2bd6-4f5b-bf14-951f2fa4a11e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:54.911027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:54.911654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:54.914083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:54.914598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:54.915670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:54.927731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:54.954411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:54.956228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 892/1780] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:54 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:54.960325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:54.984950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c64a85-2de6-4a91-9ba6-355e9a29c456 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:55.002776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e58b9c5-31c5-432c-8082-a799fa9550ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:55.008010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b9c5-31c5-432c-8082-a799fa9550ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.008010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b9c5-31c5-432c-8082-a799fa9550ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.008010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e58b9c5-31c5-432c-8082-a799fa9550ce admin admin] PATH_INFO: `/v3/projects/2a707c964d3046b5bc5690a3e2836387/users/6e394c71724b4d33863dfe87f70f174b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.011663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b9c5-31c5-432c-8082-a799fa9550ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a707c964d3046b5bc5690a3e2836387, user_id=6e394c71724b4d33863dfe87f70f174b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:55.012259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2693ace1-2351-4135-93f3-8f373ca2b3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:55.012964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ace1-2351-4135-93f3-8f373ca2b3b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.013246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ace1-2351-4135-93f3-8f373ca2b3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.013520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2693ace1-2351-4135-93f3-8f373ca2b3b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.014342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693ace1-2351-4135-93f3-8f373ca2b3b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:55.015618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e58b9c5-31c5-432c-8082-a799fa9550ce admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:55.016643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2693ace1-2351-4135-93f3-8f373ca2b3b1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:55.046003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 893/1781] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:54 2022] PUT /identity/v3/projects/2a707c964d3046b5bc5690a3e2836387/users/6e394c71724b4d33863dfe87f70f174b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:24:55.063440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.063440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.063440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.138868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] MFA Rules not processed for user `6e394c71724b4d33863dfe87f70f174b`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:55.141931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:55.172845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 889/1782] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:24:54 2022] POST /identity/v3/users => generated 303 bytes in 574 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:24:55.178287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dbc34-b362-433b-b144-8866320e0fd1 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.178702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dbc34-b362-433b-b144-8866320e0fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.179053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135dbc34-b362-433b-b144-8866320e0fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.226103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-135dbc34-b362-433b-b144-8866320e0fd1 None None] MFA Rules not processed for user `052da4ed2e054c70ba8b0bf9b6c5656a`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:55.227557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-135dbc34-b362-433b-b144-8866320e0fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:55.354030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 890/1783] 10.222.0.40 () {58 vars in 1015 bytes} [Wed Jul 27 18:24:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:55.355541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dbc34-b362-433b-b144-8866320e0fd1 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:55.357429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 894/1784] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:55 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:55.363935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:55.376179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:55.378351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:55.588572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1145aee-3455-440a-854d-c3912e0db8bb None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:55.594344 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135dbc34-b362-433b-b144-8866320e0fd1 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:55.604234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:55.610386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.610386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.610386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.610627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:55.612042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.612532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.612996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.613963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:55.615943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:55.663669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:55.665204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:55.665354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 891/1785] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:55.676577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:55.686629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:55.714046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb523c1-03dd-42b7-ad37-de273cde04ff admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:55.714135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 895/1786] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:55 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:24:55.717964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:55.722212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:55.723416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.724209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.726217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.758381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:55.760708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:55.773000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd61cb4-f572-451d-8d3c-599c9aa310e2 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:55.782447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 892/1787] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:55.799417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:55.800975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:55.803132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:55.803995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:55.804277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] PATH_INFO: `/v3/projects/7a2e5b9b483744308ff58f812cf9feec/users/8c5870057ee2457ca06c39e1f2df4d2c/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:55.854459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2e5b9b483744308ff58f812cf9feec, user_id=8c5870057ee2457ca06c39e1f2df4d2c, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:55.868829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:55.955990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 896/1788] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:55 2022] PUT /identity/v3/projects/7a2e5b9b483744308ff58f812cf9feec/users/8c5870057ee2457ca06c39e1f2df4d2c/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:55.960261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:55.967623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:55.979204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9786f598-5d00-44c0-b5b6-3bd2ab3b3eb0 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:56.110209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2f7d00-b89a-4af2-a9c1-f355fc9c11b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:56.114777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7d00-b89a-4af2-a9c1-f355fc9c11b5 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.114777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7d00-b89a-4af2-a9c1-f355fc9c11b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.114777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2f7d00-b89a-4af2-a9c1-f355fc9c11b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.137147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:56.185864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b5f4b7-f7e6-4ad3-83a6-3b1f0a562ca5 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:56.193725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:56.194752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.195359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.195892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.196821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:56.199379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:56.225383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 897/1789] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:24:56.227331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:56.240990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15245d70-9876-4663-9c88-e7535c2c183f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:56.247116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7669daa4-859e-4067-8ce2-eb0a7aca1a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:56.247973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669daa4-859e-4067-8ce2-eb0a7aca1a3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.248676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669daa4-859e-4067-8ce2-eb0a7aca1a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.249125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7669daa4-859e-4067-8ce2-eb0a7aca1a3c admin admin] PATH_INFO: `/v3/projects/7a2e5b9b483744308ff58f812cf9feec/users/8c5870057ee2457ca06c39e1f2df4d2c/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.251499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669daa4-859e-4067-8ce2-eb0a7aca1a3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a2e5b9b483744308ff58f812cf9feec, user_id=8c5870057ee2457ca06c39e1f2df4d2c, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:56.255723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7669daa4-859e-4067-8ce2-eb0a7aca1a3c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:56.263832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f7d00-b89a-4af2-a9c1-f355fc9c11b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:56.267079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2f7d00-b89a-4af2-a9c1-f355fc9c11b5 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:56.273532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 898/1790] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:24:56 2022] PUT /identity/v3/projects/7a2e5b9b483744308ff58f812cf9feec/users/8c5870057ee2457ca06c39e1f2df4d2c/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:24:56.277204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcba5a-c0b4-4d7e-8a26-e0e3762af9f8 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.277453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcba5a-c0b4-4d7e-8a26-e0e3762af9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.278261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bcba5a-c0b4-4d7e-8a26-e0e3762af9f8 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.281301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 893/1791] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:56.285625 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.285860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 899/1792] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:24:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:56.286939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.287645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.311142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.311775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.312250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.375150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:56.376898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:56.384574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] MFA Rules not processed for user `8c5870057ee2457ca06c39e1f2df4d2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:56.386286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:56.571432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 894/1793] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:56 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:56.599646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 900/1794] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:24:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:56.679750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:56.683069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:56.746339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb00f5ff-7871-4e80-8bc6-36df03ab6fd3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:56.764362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:56.765417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:56.765916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:56.766535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:56.793067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:56.799968 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:56.841596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 895/1795] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:57.058514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:57.060386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:57.279740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c6cd6-648a-4d69-b42e-cea36899b5b2 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:57.283774 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29c5ba-0a9f-4812-9f18-aa8f7a1ddf85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:57.290451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c5ba-0a9f-4812-9f18-aa8f7a1ddf85 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.290451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c5ba-0a9f-4812-9f18-aa8f7a1ddf85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.290451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29c5ba-0a9f-4812-9f18-aa8f7a1ddf85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.296632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29c5ba-0a9f-4812-9f18-aa8f7a1ddf85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:57.298438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29c5ba-0a9f-4812-9f18-aa8f7a1ddf85 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:57.311795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 901/1796] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:57 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:57.491509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:57.675087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:57.687415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14d0c5-7c98-4eae-91ea-213db5a4e667 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:57.695818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134ef5f1-6b54-48c0-9562-098a78c62013 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:57.696577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef5f1-6b54-48c0-9562-098a78c62013 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:57.697791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef5f1-6b54-48c0-9562-098a78c62013 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:57.700647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134ef5f1-6b54-48c0-9562-098a78c62013 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:57.824619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:24:57.865691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef5f1-6b54-48c0-9562-098a78c62013 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:57.867635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134ef5f1-6b54-48c0-9562-098a78c62013 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:57.886032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 896/1797] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:58.381334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd54cf5-55e8-498e-98d6-90974e017556 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.381980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd54cf5-55e8-498e-98d6-90974e017556 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.381980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd54cf5-55e8-498e-98d6-90974e017556 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.383387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 902/1798] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:24:58.393054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:58.393579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:58.394054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:58.460267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:58.461536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:58.686600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 897/1799] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:24:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:24:59.247462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.247784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.248078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.312644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] MFA Rules not processed for user `c25ffc3341b34fae80a7842c0b0fdbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:24:59.316633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:59.366583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:24:59.368029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:24:59.413016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9fe8cb-e480-403a-8ca7-130901c45377 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:24:59.431339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dd300b-af82-4c80-9871-0b55652107b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:24:59.432946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd300b-af82-4c80-9871-0b55652107b8 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:24:59.433386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd300b-af82-4c80-9871-0b55652107b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:24:59.434516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dd300b-af82-4c80-9871-0b55652107b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:24:59.473685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd300b-af82-4c80-9871-0b55652107b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:24:59.475588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dd300b-af82-4c80-9871-0b55652107b8 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:24:59.524869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 903/1800] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:24:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:24:59.528508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 898/1801] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:24:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:24:59.795613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:01.143645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:01.147608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:01.289232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141b7fb-00ad-4b60-b092-72ff6bc50b0a None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:01.307338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:01.311784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:01.312824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:01.316918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] PATH_INFO: `/v3/users/eec2694ef5bc4de185607b6eb6b4d012` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:01.321004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eec2694ef5bc4de185607b6eb6b4d012)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:01.330137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:01.489445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:01.629008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eec2694ef5bc4de185607b6eb6b4d012'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:01.630217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eec2694ef5bc4de185607b6eb6b4d012'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:01.654277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eec2694ef5bc4de185607b6eb6b4d012'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:01.655101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eec2694ef5bc4de185607b6eb6b4d012'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:01.781498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bec7409f-32c9-43d9-9ffe-239d412f0450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eec2694ef5bc4de185607b6eb6b4d012'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:01.808866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 904/1802] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:01 2022] DELETE /identity/v3/users/eec2694ef5bc4de185607b6eb6b4d012 => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:02.075446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dee55-1820-4387-9109-b43bd7129caf None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.075446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dee55-1820-4387-9109-b43bd7129caf None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.075446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155dee55-1820-4387-9109-b43bd7129caf None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.075446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 899/1803] 10.222.0.67 () {54 vars in 912 bytes} [Wed Jul 27 18:25:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:02.091111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.091397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.091995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.165814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] MFA Rules not processed for user `052da4ed2e054c70ba8b0bf9b6c5656a`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:02.167126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:02.381457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323a5d9-0d61-4688-a476-03521dc39610 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.381993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323a5d9-0d61-4688-a476-03521dc39610 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.382823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7323a5d9-0d61-4688-a476-03521dc39610 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.385771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 900/1804] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:25:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:02.390482 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 905/1805] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:25:02 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:02.422715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.423054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.426226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.434626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:02.437320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:02.455596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414edfb5-6d3b-45de-bce3-4954b714040e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:02.473373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:02.474485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.476014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.476398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.476913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:02.483709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:02.497820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:02.499533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:02.526244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 906/1806] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:02 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:02.577289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:02.656995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 901/1807] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:25:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:02.738894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:02.740448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:02.786844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61585a2-337e-4fb9-9b3b-75d5a727578a service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:02.821054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:02.821710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:02.822018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:02.822293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:02.861847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:02.863469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:02.911877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 907/1808] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:02.977470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:02.980133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:03.177515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc2855e-4da0-4540-b5a3-37ffd1601dfd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.192770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.197200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.197200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.197200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] PATH_INFO: `/v3/projects/baffc2f2abb24bae9a95102021dfd5d9` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.197470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] RBAC: Authorizing `identity:delete_project(project_id=baffc2f2abb24bae9a95102021dfd5d9)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:03.199519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:03.380132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'baffc2f2abb24bae9a95102021dfd5d9', 'request_id': 'req-c0c6a998-4081-4871-8913-923c30998982'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:03.474545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'baffc2f2abb24bae9a95102021dfd5d9', 'request_id': 'req-c0c6a998-4081-4871-8913-923c30998982'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:03.481094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'baffc2f2abb24bae9a95102021dfd5d9', 'request_id': 'req-c0c6a998-4081-4871-8913-923c30998982'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:03.512497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] The token cache is being invalidate because project baffc2f2abb24bae9a95102021dfd5d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:03.513052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:03.513997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:03.515730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 902/1809] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:02 2022] DELETE /identity/v3/projects/baffc2f2abb24bae9a95102021dfd5d9 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:03.520676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:03.538694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f9617-9824-4a3f-8a1a-865ab5200c68 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:03.719449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:03.719449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:03.719449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:03.719449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] PATH_INFO: `/v3/users/5de2728af17041e8b2717d2549a72ffe` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:03.719781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5de2728af17041e8b2717d2549a72ffe)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:03.719781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.080518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:04.081507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5de2728af17041e8b2717d2549a72ffe'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:04.082426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5de2728af17041e8b2717d2549a72ffe'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:04.126338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5de2728af17041e8b2717d2549a72ffe'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:04.144194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5de2728af17041e8b2717d2549a72ffe'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:04.245674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5de2728af17041e8b2717d2549a72ffe'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:04.280238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 908/1810] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:03 2022] DELETE /identity/v3/users/5de2728af17041e8b2717d2549a72ffe => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:04.427481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:04.429592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:04.457510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c6a998-4081-4871-8913-923c30998982 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:04.670924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:04.672228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:04.684650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:04.684650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] PATH_INFO: `/v3/users/4c9453e773414a0b84b929453b9e3b2d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:04.686879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c9453e773414a0b84b929453b9e3b2d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:04.712854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:04.803263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:05.078645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c9453e773414a0b84b929453b9e3b2d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.144729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.149007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.258553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f7834-6bb3-491f-8ea5-3736fb545964 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.281251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.284001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.292024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.297974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] PATH_INFO: `/v3/projects/7e8bfb6662ed41958a31bb599b2d2292` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.300690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e8bfb6662ed41958a31bb599b2d2292)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.306650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.372820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c9453e773414a0b84b929453b9e3b2d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.382133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c9453e773414a0b84b929453b9e3b2d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.399346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c9453e773414a0b84b929453b9e3b2d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.400507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6bf9dd79-768f-491d-9276-fee684157068 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c9453e773414a0b84b929453b9e3b2d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.407770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 903/1811] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:04 2022] DELETE /identity/v3/users/4c9453e773414a0b84b929453b9e3b2d => generated 0 bytes in 981 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:05.415350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.415740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.416127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.438274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:05.440714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.522006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e8bfb6662ed41958a31bb599b2d2292', 'request_id': 'req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.522006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e8bfb6662ed41958a31bb599b2d2292', 'request_id': 'req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.522006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e8bfb6662ed41958a31bb599b2d2292', 'request_id': 'req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.533664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 904/1812] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:05.546111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.548083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.607062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535b2b1-1b53-432c-ad84-09360ada20d6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.642903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] The token cache is being invalidate because project 7e8bfb6662ed41958a31bb599b2d2292 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:05.646811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.646811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0bf1ee48-be0b-4d5d-bb92-af2b2d45a27f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:05.646811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 909/1813] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:05 2022] DELETE /identity/v3/projects/7e8bfb6662ed41958a31bb599b2d2292 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:05.651039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9a4f-b945-4f3e-83a5-a136d64edcab None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.651325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9a4f-b945-4f3e-83a5-a136d64edcab None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.651602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53c9a4f-b945-4f3e-83a5-a136d64edcab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.658827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.659677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.660783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.661068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.662882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.670737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a53c9a4f-b945-4f3e-83a5-a136d64edcab None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:05.675462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a53c9a4f-b945-4f3e-83a5-a136d64edcab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.725744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.727199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.732275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 910/1814] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:05.739869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 905/1815] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:05.748054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176b060-4091-41f0-8f69-2ea2197c309f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.751146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176b060-4091-41f0-8f69-2ea2197c309f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.751146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176b060-4091-41f0-8f69-2ea2197c309f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.775885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c176b060-4091-41f0-8f69-2ea2197c309f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:05.779350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c176b060-4091-41f0-8f69-2ea2197c309f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.793856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 911/1816] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:05.795101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.805292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8119336-2a05-4e01-bebe-839634130a5a service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.810487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.831862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.831862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.831862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.831862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:05.831862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.831862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.832592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 906/1817] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:05.836317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176b060-4091-41f0-8f69-2ea2197c309f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.838785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:05.840703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:05.846891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c176b060-4091-41f0-8f69-2ea2197c309f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.852391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.853122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.853501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.853916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.854740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.857161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.862248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b13124-c646-4730-85fd-0b755cf1d996 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:05.876279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:05.877853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:05.878436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:05.879393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] PATH_INFO: `/v3/users/d63a2591a753478385f29dbefc6bf2cb` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:05.880627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63a2591a753478385f29dbefc6bf2cb)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:05.882587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:05.975454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 912/1818] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:05 2022] POST /identity/v3/projects => generated 383 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:05.977219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.009017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.055337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eec49d-1568-4f6d-a4e8-bff4a919aeea admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.064074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.065259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.065683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.071259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.071259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.071259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.117036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63a2591a753478385f29dbefc6bf2cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.118538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.177869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 913/1819] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:05 2022] POST /identity/v3/users => generated 292 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:06.179978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.199799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63a2591a753478385f29dbefc6bf2cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.201046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901ed5d-9370-4228-8d09-d88b2370e083 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.205090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63a2591a753478385f29dbefc6bf2cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.212502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.213323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.213710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.214097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.214912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.216790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.222361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63a2591a753478385f29dbefc6bf2cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.226184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7dbdb71a-c34b-4396-84f4-0c8501b78053 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63a2591a753478385f29dbefc6bf2cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.231627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 914/1820] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:06.233123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.233921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 907/1821] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:05 2022] DELETE /identity/v3/users/d63a2591a753478385f29dbefc6bf2cb => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:06.234444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:06.236520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.236813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.237089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.253060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98966708-371b-4ebe-b912-9035c3f5832c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.257308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:06.260287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:06.369950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 908/1822] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:06.374277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.377028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.378938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.379229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.379509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.380769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:06.381649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.386363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.400661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeaf173-db4d-4f38-9bd1-1a1e5efc8e04 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.409499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 915/1823] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:06.409499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.413585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.415302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.415590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.415870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] PATH_INFO: `/v3/projects/76a945bf22014b3882455e0c8c081686` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.418275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:06.418955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] RBAC: Authorizing `identity:delete_project(project_id=76a945bf22014b3882455e0c8c081686)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.423621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.505646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f961cf-72d2-4857-8598-0fa39532de0a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.510546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.513519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.513519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.513519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.526114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.527561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.543691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 916/1824] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:06.544610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.560322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387690f-091a-4ec6-ba45-a8d94d202cc5 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.567953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc797c98-93a3-4b7b-8df4-6b201ae481d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.568629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc797c98-93a3-4b7b-8df4-6b201ae481d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.568909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc797c98-93a3-4b7b-8df4-6b201ae481d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.569291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc797c98-93a3-4b7b-8df4-6b201ae481d5 admin admin] PATH_INFO: `/v3/projects/da93c09b396d4229bbf7d29e3696e104/users/29ab75faa3c945959e383a69cf755d6c/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.590657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc797c98-93a3-4b7b-8df4-6b201ae481d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da93c09b396d4229bbf7d29e3696e104, user_id=29ab75faa3c945959e383a69cf755d6c, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.591499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76a945bf22014b3882455e0c8c081686', 'request_id': 'req-cb1f621d-6617-40dc-9185-60e3e950fdee'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.594265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc797c98-93a3-4b7b-8df4-6b201ae481d5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.709274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:06.712365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76a945bf22014b3882455e0c8c081686', 'request_id': 'req-cb1f621d-6617-40dc-9185-60e3e950fdee'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.731863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76a945bf22014b3882455e0c8c081686', 'request_id': 'req-cb1f621d-6617-40dc-9185-60e3e950fdee'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.732714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 917/1825] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:06 2022] PUT /identity/v3/projects/da93c09b396d4229bbf7d29e3696e104/users/29ab75faa3c945959e383a69cf755d6c/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:06.743198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.743198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.743700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.746259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] The token cache is being invalidate because project 76a945bf22014b3882455e0c8c081686 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:06.746500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.751588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:06.751588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 909/1826] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:06 2022] DELETE /identity/v3/projects/76a945bf22014b3882455e0c8c081686 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:06.754238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:06.756118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:06.824413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] MFA Rules not processed for user `29ab75faa3c945959e383a69cf755d6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:06.827513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:06.856962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1f621d-6617-40dc-9185-60e3e950fdee admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:06.977805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:06.978472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:06.979174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:06.979174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] PATH_INFO: `/v3/users/6e394c71724b4d33863dfe87f70f174b` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:06.981589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e394c71724b4d33863dfe87f70f174b)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:06.988109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:06.999615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 918/1827] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:07.005156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.005736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:07.022864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b7163-4f0c-456d-96ec-14be61e5093a None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.029360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.030904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.030904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.031321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.032071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.034436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.182487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 919/1828] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:07 2022] POST /identity/v3/projects => generated 383 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:07.186762 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.229863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e394c71724b4d33863dfe87f70f174b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.302308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f258ca-b561-49a7-94f9-93de2c7b2bd9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.308260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e394c71724b4d33863dfe87f70f174b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.321141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e394c71724b4d33863dfe87f70f174b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.323936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.324641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.324925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.325233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.325941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.328120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.344925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e394c71724b4d33863dfe87f70f174b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.347929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e394c71724b4d33863dfe87f70f174b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.367770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 910/1829] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:06 2022] DELETE /identity/v3/users/6e394c71724b4d33863dfe87f70f174b => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:07.369517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.374482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:07.470430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6692e00a-bb14-4f91-87f0-98940f0a7a2c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.476507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.477621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.478046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.478404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] PATH_INFO: `/v3/projects/f646429fb4f84dd5a2c4efbf27da9ba2` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.499222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 920/1830] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:07 2022] POST /identity/v3/users => generated 298 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:07.499416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f646429fb4f84dd5a2c4efbf27da9ba2)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.499416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.499589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.501403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:07.516486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6cc3b-2648-4004-8539-e531a69e7016 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.519737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:07.529017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.533289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.533289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.533289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.533289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.534362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.546360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 921/1831] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:07.551072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.561459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3940fe-2e23-46db-9454-26418d4ab661 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.566918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.567674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.568021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.568364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] PATH_INFO: `/v3/projects/3d954f8414cf44eea0fbe772902bf204/users/4d4754b6a66b443b90c89cb1e48e7846/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.583891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d954f8414cf44eea0fbe772902bf204, user_id=4d4754b6a66b443b90c89cb1e48e7846, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.590177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.747734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 922/1832] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:07 2022] PUT /identity/v3/projects/3d954f8414cf44eea0fbe772902bf204/users/4d4754b6a66b443b90c89cb1e48e7846/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:07.752028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.755591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f646429fb4f84dd5a2c4efbf27da9ba2', 'request_id': 'req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.824035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3948a-36e7-432e-a26b-a1465ee7d058 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.854406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f646429fb4f84dd5a2c4efbf27da9ba2', 'request_id': 'req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.862203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f646429fb4f84dd5a2c4efbf27da9ba2', 'request_id': 'req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.888193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] The token cache is being invalidate because project f646429fb4f84dd5a2c4efbf27da9ba2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:07.888890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.889954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:07.893289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 911/1833] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:07 2022] DELETE /identity/v3/projects/f646429fb4f84dd5a2c4efbf27da9ba2 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:07.896772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.898248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:07.914495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.915131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.915415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.915692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.916391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.918103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.928966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 923/1834] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:07 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:07.932963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:07.935819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:07.956481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6c3242-066b-49f9-bacc-1e919b5e31e3 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.971474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb5367c-deec-476a-9a72-0b849cc2f963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:07.972166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5367c-deec-476a-9a72-0b849cc2f963 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:07.972448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5367c-deec-476a-9a72-0b849cc2f963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:07.972722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb5367c-deec-476a-9a72-0b849cc2f963 admin admin] PATH_INFO: `/v3/projects/3d954f8414cf44eea0fbe772902bf204/users/4d4754b6a66b443b90c89cb1e48e7846/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:07.975322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5367c-deec-476a-9a72-0b849cc2f963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d954f8414cf44eea0fbe772902bf204, user_id=4d4754b6a66b443b90c89cb1e48e7846, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:07.978348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb5367c-deec-476a-9a72-0b849cc2f963 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:07.985309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2787bd-c68c-4a31-9467-efdc83d2dd9c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:07.997849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 924/1835] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:07 2022] PUT /identity/v3/projects/3d954f8414cf44eea0fbe772902bf204/users/4d4754b6a66b443b90c89cb1e48e7846/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:08.003027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.003316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.003590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.038184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] MFA Rules not processed for user `4d4754b6a66b443b90c89cb1e48e7846`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:08.039678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.055428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.056249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.056596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.056940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] PATH_INFO: `/v3/users/8c5870057ee2457ca06c39e1f2df4d2c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.068708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c5870057ee2457ca06c39e1f2df4d2c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.072054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.133579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 925/1836] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:08.144558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.145956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.202469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ded7ae0-d334-4237-b0c4-cbe0c7a02934 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.207105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.207733 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.208014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.208288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.218363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.221327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.231471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 926/1837] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:08.232326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.233630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.246633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76619c52-7b15-459b-9276-14a3ba58c49c service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.251169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.251800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.252088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.252365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] PATH_INFO: `/v3/projects/2a707c964d3046b5bc5690a3e2836387` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.253519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a707c964d3046b5bc5690a3e2836387)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.255524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.341995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c5870057ee2457ca06c39e1f2df4d2c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.362730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a707c964d3046b5bc5690a3e2836387', 'request_id': 'req-bf34c0a4-88c0-4438-8f6f-7797764db87a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.368070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a707c964d3046b5bc5690a3e2836387', 'request_id': 'req-bf34c0a4-88c0-4438-8f6f-7797764db87a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.373983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a707c964d3046b5bc5690a3e2836387', 'request_id': 'req-bf34c0a4-88c0-4438-8f6f-7797764db87a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.462411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c5870057ee2457ca06c39e1f2df4d2c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.471204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c5870057ee2457ca06c39e1f2df4d2c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.489321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c5870057ee2457ca06c39e1f2df4d2c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.489321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c5870057ee2457ca06c39e1f2df4d2c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.502373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 912/1838] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:07 2022] DELETE /identity/v3/users/8c5870057ee2457ca06c39e1f2df4d2c => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:08.502373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.502373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.590055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] The token cache is being invalidate because project 2a707c964d3046b5bc5690a3e2836387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:08.592922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.592922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-bf34c0a4-88c0-4438-8f6f-7797764db87a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:08.599929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 927/1839] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:08 2022] DELETE /identity/v3/projects/2a707c964d3046b5bc5690a3e2836387 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:08.602554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6884b02-4455-40c2-bd0f-0dc901521245 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.602841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6884b02-4455-40c2-bd0f-0dc901521245 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.604997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6884b02-4455-40c2-bd0f-0dc901521245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.610909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc99372-c01a-4c23-8b41-8292f299e10f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.614894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667b2a-0175-4844-a42e-936f8a9b589b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.615611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667b2a-0175-4844-a42e-936f8a9b589b service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.615899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667b2a-0175-4844-a42e-936f8a9b589b service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.616177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667b2a-0175-4844-a42e-936f8a9b589b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.618052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-15667b2a-0175-4844-a42e-936f8a9b589b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.648879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a6884b02-4455-40c2-bd0f-0dc901521245 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:08.651053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a6884b02-4455-40c2-bd0f-0dc901521245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.688593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15667b2a-0175-4844-a42e-936f8a9b589b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.691999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15667b2a-0175-4844-a42e-936f8a9b589b service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.702578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 913/1840] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:08.759302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 928/1841] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:08.767932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e532e-9f4c-4e2c-87b3-8257ab52f27a None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.769184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e532e-9f4c-4e2c-87b3-8257ab52f27a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.769660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e532e-9f4c-4e2c-87b3-8257ab52f27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.805847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ad5e532e-9f4c-4e2c-87b3-8257ab52f27a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:08.807971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ad5e532e-9f4c-4e2c-87b3-8257ab52f27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:08.825794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 914/1842] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:08.831147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6884b02-4455-40c2-bd0f-0dc901521245 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.840519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:08.858073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6884b02-4455-40c2-bd0f-0dc901521245 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.879016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.882091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.882610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.883107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.889500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:08.892522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:08.896256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:08.958161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 929/1843] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:08.963038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e532e-9f4c-4e2c-87b3-8257ab52f27a None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:08.985253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e532e-9f4c-4e2c-87b3-8257ab52f27a None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:08.993982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:08.995158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:08.995753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:08.996678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:08.998040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.002428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.129431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 915/1844] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:08 2022] POST /identity/v3/projects => generated 385 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:09.132271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.149746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ec55f7-b6d0-4ba0-88eb-b8196f9821d9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.235285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.235978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.236335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.236528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.237202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.245318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.356651 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 930/1845] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:09 2022] POST /identity/v3/users => generated 293 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:09.360425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.377370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5af80b-0018-4582-b4c9-7b96e84f48a3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.393899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.394544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.394998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.396522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.397542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.402239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.441880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 916/1846] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:09.443125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.467540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f5daa-44ab-4eb9-8180-b076c29e8c07 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.479385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a473c78-3bf5-4596-bfc0-5fde403c88f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.480040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473c78-3bf5-4596-bfc0-5fde403c88f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.480324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473c78-3bf5-4596-bfc0-5fde403c88f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.480600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a473c78-3bf5-4596-bfc0-5fde403c88f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.481297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a473c78-3bf5-4596-bfc0-5fde403c88f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.494276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a473c78-3bf5-4596-bfc0-5fde403c88f8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.516030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 931/1847] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:09 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:09.519967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.536900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8245bda-5c97-4970-a74e-5a9943d1e6ca admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.543354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.544040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.544322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.544591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] PATH_INFO: `/v3/projects/39df0efcf2b0403f8d94c184f58c0c03/users/b0b9e21b2dfd44efb551b1fbb9b00512/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.563746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39df0efcf2b0403f8d94c184f58c0c03, user_id=b0b9e21b2dfd44efb551b1fbb9b00512, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.567300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.681277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 917/1848] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:09 2022] PUT /identity/v3/projects/39df0efcf2b0403f8d94c184f58c0c03/users/b0b9e21b2dfd44efb551b1fbb9b00512/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:09.692258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.692546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.692820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.721246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] MFA Rules not processed for user `b0b9e21b2dfd44efb551b1fbb9b00512`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:09.722535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:09.796091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:09.807282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 932/1849] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:09.808377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.886499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde5841-c5bf-46d0-b684-5968d8d8bdf8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.891578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.892236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.892517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.892822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.895176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.895564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:09.903232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:09.905365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:09.922876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a613d8fe-c065-4c9d-bb7e-78f865278588 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:09.929706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:09.930642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:09.931250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:09.931443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] PATH_INFO: `/v3/projects/7a2e5b9b483744308ff58f812cf9feec` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:09.932872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a2e5b9b483744308ff58f812cf9feec)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:09.934940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:10.033970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 918/1850] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:09 2022] POST /identity/v3/projects => generated 387 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:10.037611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:10.052854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a2e5b9b483744308ff58f812cf9feec', 'request_id': 'req-cf816530-b66b-41c8-b32f-f26bd636e86f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:10.060571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a2e5b9b483744308ff58f812cf9feec', 'request_id': 'req-cf816530-b66b-41c8-b32f-f26bd636e86f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:10.068538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a2e5b9b483744308ff58f812cf9feec', 'request_id': 'req-cf816530-b66b-41c8-b32f-f26bd636e86f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:10.121640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c610d00a-55d4-4fdd-aac1-3dcd92231ea4 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:10.186315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:10.186900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:10.187177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:10.187448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:10.188117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:10.190612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:10.675558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] The token cache is being invalidate because project 7a2e5b9b483744308ff58f812cf9feec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:10.699968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:10.699968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf816530-b66b-41c8-b32f-f26bd636e86f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:10.699968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 933/1851] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:09 2022] DELETE /identity/v3/projects/7a2e5b9b483744308ff58f812cf9feec => generated 0 bytes in 783 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:10.710873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab21fa-cab8-49b8-94b0-b8b7f0ce90e3 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:10.711289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab21fa-cab8-49b8-94b0-b8b7f0ce90e3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:10.712243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ab21fa-cab8-49b8-94b0-b8b7f0ce90e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:10.744348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-14ab21fa-cab8-49b8-94b0-b8b7f0ce90e3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:10.745666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-14ab21fa-cab8-49b8-94b0-b8b7f0ce90e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:10.786748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 934/1852] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:10.790521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b917-d0e9-4881-83f7-9237485725f3 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:10.790972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b917-d0e9-4881-83f7-9237485725f3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:10.791451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8835b917-d0e9-4881-83f7-9237485725f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:10.836849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8835b917-d0e9-4881-83f7-9237485725f3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:10.838473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8835b917-d0e9-4881-83f7-9237485725f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:10.852750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 935/1853] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:10.854357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835b917-d0e9-4881-83f7-9237485725f3 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:10.868318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8835b917-d0e9-4881-83f7-9237485725f3 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:10.873308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:10.874156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:10.874529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:10.874897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:10.875703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:10.876138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:10.877921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:10.894460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 936/1854] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:10.895566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:10.913741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2c8a17-2130-42f6-b6b4-e3bd6c160b6b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:10.918892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:10.919633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:10.920011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:10.920381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:10.921053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:10.924037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.166230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 919/1855] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:10 2022] POST /identity/v3/users => generated 300 bytes in 1129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:11.169881 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.171508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:11.184154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a92a5-d77d-4151-a682-be471dad5a36 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.189197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.190066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.190186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.190398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.191086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.192682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.202809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 920/1856] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:11.207385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.217080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866a340-8661-4696-8ce7-1d37e0fbebbf admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.226359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.227050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.227336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.227612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] PATH_INFO: `/v3/projects/8ba853d100ef456490ea8875defd1e85/users/aa066cfb717b40689c9a7f5f033df028/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.230942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 937/1857] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:10 2022] POST /identity/v3/projects => generated 389 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:11.236759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.278554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba853d100ef456490ea8875defd1e85, user_id=aa066cfb717b40689c9a7f5f033df028, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.284472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.339374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da96767-10f3-480b-996f-8bd982f9ef80 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.345049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.345877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.346271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.346641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.347401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.349396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.451690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 921/1858] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:11 2022] PUT /identity/v3/projects/8ba853d100ef456490ea8875defd1e85/users/aa066cfb717b40689c9a7f5f033df028/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:11.457801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.466660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 938/1859] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:11 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:11.467977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.480329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0549d08-fafd-42d6-a594-584eb13b8533 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.530301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a71d3-c929-4ed3-b6ba-58f1fb62154d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.537223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df515291-ea1a-43a0-a155-92a1cb8db9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.537875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df515291-ea1a-43a0-a155-92a1cb8db9bd admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.538158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df515291-ea1a-43a0-a155-92a1cb8db9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.538427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df515291-ea1a-43a0-a155-92a1cb8db9bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.539144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df515291-ea1a-43a0-a155-92a1cb8db9bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.540811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df515291-ea1a-43a0-a155-92a1cb8db9bd admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.549143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba155112-9f61-4947-a94f-c57d0bfa93cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.549143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba155112-9f61-4947-a94f-c57d0bfa93cc admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.549143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba155112-9f61-4947-a94f-c57d0bfa93cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.549973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba155112-9f61-4947-a94f-c57d0bfa93cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.551874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba155112-9f61-4947-a94f-c57d0bfa93cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.553736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba155112-9f61-4947-a94f-c57d0bfa93cc admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.556160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 922/1860] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:11.557621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1a36d-eaf1-4b81-984e-8f23e49e7497 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.557842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1a36d-eaf1-4b81-984e-8f23e49e7497 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.558189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c1a36d-eaf1-4b81-984e-8f23e49e7497 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.559795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 923/1861] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:25:11.560540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1a36d-eaf1-4b81-984e-8f23e49e7497 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 939/1862] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:11.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4450e68-8cd1-4b52-b6e2-2c6b82f14477 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4450e68-8cd1-4b52-b6e2-2c6b82f14477 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.569713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4450e68-8cd1-4b52-b6e2-2c6b82f14477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.577490 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c1a36d-eaf1-4b81-984e-8f23e49e7497 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.582519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.583296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.583579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.583833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] PATH_INFO: `/v3/projects/8ba853d100ef456490ea8875defd1e85/users/aa066cfb717b40689c9a7f5f033df028/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.587012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba853d100ef456490ea8875defd1e85, user_id=aa066cfb717b40689c9a7f5f033df028, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.589701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.590350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a4450e68-8cd1-4b52-b6e2-2c6b82f14477 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:11.591666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a4450e68-8cd1-4b52-b6e2-2c6b82f14477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:11.611769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 924/1863] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:11 2022] PUT /identity/v3/projects/8ba853d100ef456490ea8875defd1e85/users/aa066cfb717b40689c9a7f5f033df028/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:11.611769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.675841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3039719-1b61-43b7-8b98-aed6b0799cc8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.679243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 940/1864] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:25:11 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:11.682761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.682761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.682761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.684499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.685401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.685989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.686431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.687974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.691396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.703816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 925/1865] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:11.704980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.708229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:11.715379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] MFA Rules not processed for user `aa066cfb717b40689c9a7f5f033df028`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:11.717144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:11.802162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb1003-d594-496e-8348-13e285ed61b7 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.815765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.820507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.820507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.820507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.832842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.834507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.847166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 926/1866] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:11.847697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 941/1867] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:11 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:11.848550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.855084 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:11.856484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:11.882733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa08622-8bf3-4a8d-9ae3-3f69932a6376 service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.905796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e13af0f-134e-4f33-84f8-c1da1c488b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.906640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13af0f-134e-4f33-84f8-c1da1c488b78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.906829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13af0f-134e-4f33-84f8-c1da1c488b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.907102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e13af0f-134e-4f33-84f8-c1da1c488b78 admin admin] PATH_INFO: `/v3/projects/999b7fe28f1b491f8c7e740f2b5f4fc0/users/e410db79b7884887b756c122ca271b88/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.932372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13af0f-134e-4f33-84f8-c1da1c488b78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=999b7fe28f1b491f8c7e740f2b5f4fc0, user_id=e410db79b7884887b756c122ca271b88, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.935668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e13af0f-134e-4f33-84f8-c1da1c488b78 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:11.942497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1221d1-0f47-41e2-807d-fee864a4e63c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:11.947471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:11.948366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:11.948864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:11.949240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:11.964845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:11.966337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:12.003756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 942/1868] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:12.048668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:12.066753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 927/1869] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:11 2022] PUT /identity/v3/projects/999b7fe28f1b491f8c7e740f2b5f4fc0/users/e410db79b7884887b756c122ca271b88/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:12.079957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6076967-b982-46d0-b209-a049aa71686b service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:12.087503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d657fe-9fb4-40c9-9f73-48ae065a1ad6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.087783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d657fe-9fb4-40c9-9f73-48ae065a1ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.088057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d657fe-9fb4-40c9-9f73-48ae065a1ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.160352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-97d657fe-9fb4-40c9-9f73-48ae065a1ad6 None None] MFA Rules not processed for user `e410db79b7884887b756c122ca271b88`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:12.161744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-97d657fe-9fb4-40c9-9f73-48ae065a1ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:12.245232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:12.245861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.246143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.246411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] PATH_INFO: `/v3/users/b0b9e21b2dfd44efb551b1fbb9b00512` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.248253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0b9e21b2dfd44efb551b1fbb9b00512)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:12.251457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:12.323026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 928/1870] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:12 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:12.324654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d657fe-9fb4-40c9-9f73-48ae065a1ad6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:12.360386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d657fe-9fb4-40c9-9f73-48ae065a1ad6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:12.372372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:12.373113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.373647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.374238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.375316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:12.379078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:12.503749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 929/1871] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:12 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:12.507921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:12.583141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0b9e21b2dfd44efb551b1fbb9b00512'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:12.585097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0b9e21b2dfd44efb551b1fbb9b00512'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:12.614486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0b9e21b2dfd44efb551b1fbb9b00512'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:12.620750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0b9e21b2dfd44efb551b1fbb9b00512'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:12.643453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c96698-2df9-4e4f-9376-88c9bc876c77 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:12.649751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:12.650411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.650684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.650960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.651687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:12.655710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:12.762632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-200b69c0-0891-4bf6-8762-24d551f4d45f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0b9e21b2dfd44efb551b1fbb9b00512'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:12.775906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 943/1872] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:12 2022] DELETE /identity/v3/users/b0b9e21b2dfd44efb551b1fbb9b00512 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:12.780742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.780742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.780990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.795082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 930/1873] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:12 2022] POST /identity/v3/users => generated 300 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:12.800104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:12.802341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:12.825031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2d5eb1-9f4c-4fd5-a8cf-cb905572e159 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:12.830144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:12.831408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:12.918829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 944/1874] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:12.928866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:12.930642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:12.930854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.931436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.932059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:12.932178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:12.933692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:12.937920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:12.959867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 931/1875] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:12.964695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:12.967087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:12.980954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c944a2d-276c-4f46-bcfc-52bbafb2bea1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:12.986159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:12.986833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:12.987116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:12.987422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] PATH_INFO: `/v3/projects/fc893eeedc5c4368af5719391ee49b00/users/ca25b913901c4e8ab75c78a5662d727f/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.002483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e67ef42-3e92-49fa-bcc2-a2b2cd2ec84f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.002912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc893eeedc5c4368af5719391ee49b00, user_id=ca25b913901c4e8ab75c78a5662d727f, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.007556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.007879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.007958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.007958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.007958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.018970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.020523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.030218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 945/1876] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:13.103901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 932/1877] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:12 2022] PUT /identity/v3/projects/fc893eeedc5c4368af5719391ee49b00/users/ca25b913901c4e8ab75c78a5662d727f/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:13.107867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.122966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae207c0e-a182-44e5-8b76-d11342822ab4 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.186167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7622df58-e9ae-45ed-a13b-85e103bd2bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.186783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622df58-e9ae-45ed-a13b-85e103bd2bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.187058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622df58-e9ae-45ed-a13b-85e103bd2bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.187327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7622df58-e9ae-45ed-a13b-85e103bd2bfd admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.188012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622df58-e9ae-45ed-a13b-85e103bd2bfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.190316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7622df58-e9ae-45ed-a13b-85e103bd2bfd admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.204648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 946/1878] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:13.206374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.216619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a1d5ae-cd7b-477a-9da4-400a362419b8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.221509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.222215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.222502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.222781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] PATH_INFO: `/v3/projects/fc893eeedc5c4368af5719391ee49b00/users/ca25b913901c4e8ab75c78a5662d727f/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.224711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc893eeedc5c4368af5719391ee49b00, user_id=ca25b913901c4e8ab75c78a5662d727f, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.227396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.238247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 933/1879] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:13 2022] PUT /identity/v3/projects/fc893eeedc5c4368af5719391ee49b00/users/ca25b913901c4e8ab75c78a5662d727f/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:13.248478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.248806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.249114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.289028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] MFA Rules not processed for user `ca25b913901c4e8ab75c78a5662d727f`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:13.290329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:13.378944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 947/1880] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:13 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:13.389642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.392010 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:13.462307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0c3610-dae9-48eb-bb6a-aa3bb7dfac70 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.467381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.468028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.469221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.469909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.487511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.490520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.513585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 934/1881] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:13 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:13.554010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.555661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:13.663715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6051831-21ca-4520-9e4b-8e1eb94f1425 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.668151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:13.668593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.669492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.669971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:13.670245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.670715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] PATH_INFO: `/v3/users/29ab75faa3c945959e383a69cf755d6c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.672401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29ab75faa3c945959e383a69cf755d6c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.675800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.712619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6069630b-7c8b-40dd-8932-374a6395a907 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:13.719385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:13.720565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:13.720992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:13.721429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] PATH_INFO: `/v3/projects/39df0efcf2b0403f8d94c184f58c0c03` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:13.722829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] RBAC: Authorizing `identity:delete_project(project_id=39df0efcf2b0403f8d94c184f58c0c03)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:13.725931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:13.914211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29ab75faa3c945959e383a69cf755d6c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:13.919197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29ab75faa3c945959e383a69cf755d6c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:13.922830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39df0efcf2b0403f8d94c184f58c0c03', 'request_id': 'req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:13.941553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29ab75faa3c945959e383a69cf755d6c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:13.942423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29ab75faa3c945959e383a69cf755d6c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.008216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39df0efcf2b0403f8d94c184f58c0c03', 'request_id': 'req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.015453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39df0efcf2b0403f8d94c184f58c0c03', 'request_id': 'req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.027190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] The token cache is being invalidate because project 39df0efcf2b0403f8d94c184f58c0c03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:14.027435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.028125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.029688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 935/1882] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:13 2022] DELETE /identity/v3/projects/39df0efcf2b0403f8d94c184f58c0c03 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:14.033126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.033126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.091569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29ab75faa3c945959e383a69cf755d6c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.114339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4cf4d5-7b8c-4b61-a49e-2166b0c3c16e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.124717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 948/1883] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:13 2022] DELETE /identity/v3/users/29ab75faa3c945959e383a69cf755d6c => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:14.125373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.129449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.132137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.132911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.133200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.133536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] PATH_INFO: `/v3/users/e410db79b7884887b756c122ca271b88` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.134884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e410db79b7884887b756c122ca271b88)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.142386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.220078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c93255-1f5e-4b79-9075-c3e53f2919b6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.227646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.228450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.228737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.229083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] PATH_INFO: `/v3/users/aa066cfb717b40689c9a7f5f033df028` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.230604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa066cfb717b40689c9a7f5f033df028)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.232815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.291015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:14.366474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e410db79b7884887b756c122ca271b88'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.430552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa066cfb717b40689c9a7f5f033df028'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.431239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa066cfb717b40689c9a7f5f033df028'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.443516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa066cfb717b40689c9a7f5f033df028'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.444166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa066cfb717b40689c9a7f5f033df028'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.450973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e410db79b7884887b756c122ca271b88'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.460611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e410db79b7884887b756c122ca271b88'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.475437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e410db79b7884887b756c122ca271b88'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.476184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7ae8f78e-7be4-45ab-97fa-b4190df27b8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e410db79b7884887b756c122ca271b88'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.484621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 936/1884] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:14 2022] DELETE /identity/v3/users/e410db79b7884887b756c122ca271b88 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:14.486440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b76a-d5a4-46d8-b67a-65d83e33bd93 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.486810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b76a-d5a4-46d8-b67a-65d83e33bd93 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.487264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b76a-d5a4-46d8-b67a-65d83e33bd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.513747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7803b76a-d5a4-46d8-b67a-65d83e33bd93 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:14.515052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7803b76a-d5a4-46d8-b67a-65d83e33bd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.602602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa066cfb717b40689c9a7f5f033df028'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:14.606670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 937/1885] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:14.611189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.611478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.611760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.632550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 949/1886] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:14 2022] DELETE /identity/v3/users/aa066cfb717b40689c9a7f5f033df028 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:14.633689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.639929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.642252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:14.643505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.739983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 938/1887] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:14.752799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:14.753410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd12a1-43d3-49fa-b2f1-5c975ec19804 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.755902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:14.766846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.769385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.769807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.770214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.783305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45571d2a-950f-4a0b-b123-835fe401f920 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:14.788874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:14.789529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:14.790014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:14.790131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:14.795902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.797534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.806938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:14.808655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:14.822362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 950/1888] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:14.827367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 939/1889] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:15.449351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:15.451598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:15.483161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fac570-0763-4cbd-9f4a-b80b60ff437e service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:15.501567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:15.515885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:15.521145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:15.521510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] PATH_INFO: `/v3/projects/8ba853d100ef456490ea8875defd1e85` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:15.524711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba853d100ef456490ea8875defd1e85)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:15.535588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:15.665622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:15.668398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:15.695706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a1254-9f82-4470-881f-d71aabffeda3 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:15.703166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:15.704883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:15.705482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:15.706022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] PATH_INFO: `/v3/projects/da93c09b396d4229bbf7d29e3696e104` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:15.707699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=da93c09b396d4229bbf7d29e3696e104)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:15.710087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:15.802182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba853d100ef456490ea8875defd1e85', 'request_id': 'req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:15.822880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba853d100ef456490ea8875defd1e85', 'request_id': 'req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:15.838797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba853d100ef456490ea8875defd1e85', 'request_id': 'req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:15.892039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da93c09b396d4229bbf7d29e3696e104', 'request_id': 'req-19c7e0dd-53ea-458f-b884-55f9d544dd1b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:15.972441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] The token cache is being invalidate because project 8ba853d100ef456490ea8875defd1e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:15.972731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:15.973907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-27968bfd-ea0e-4df7-9dd8-a2c995c475ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:15.982296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 951/1890] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:15 2022] DELETE /identity/v3/projects/8ba853d100ef456490ea8875defd1e85 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:15.987331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:15.987619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:15.991939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.024467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:16.025802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:16.065397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da93c09b396d4229bbf7d29e3696e104', 'request_id': 'req-19c7e0dd-53ea-458f-b884-55f9d544dd1b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.071779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da93c09b396d4229bbf7d29e3696e104', 'request_id': 'req-19c7e0dd-53ea-458f-b884-55f9d544dd1b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.084585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] The token cache is being invalidate because project da93c09b396d4229bbf7d29e3696e104 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:16.085206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.085960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.088274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 940/1891] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:15 2022] DELETE /identity/v3/projects/da93c09b396d4229bbf7d29e3696e104 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:16.089594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:16.091257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:16.105532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 952/1892] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:16.106677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:16.106796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7e0dd-53ea-458f-b884-55f9d544dd1b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:16.107961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:16.122516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea133e6-3ac0-47a5-b88e-f864f62d0fef None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:16.126277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:16.126277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.126277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.126277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] PATH_INFO: `/v3/projects/999b7fe28f1b491f8c7e740f2b5f4fc0` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.126645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=999b7fe28f1b491f8c7e740f2b5f4fc0)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:16.127257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:16.127907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.128187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.128458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] PATH_INFO: `/v3/users/4d4754b6a66b443b90c89cb1e48e7846` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.128679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:16.129634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d4754b6a66b443b90c89cb1e48e7846)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:16.131578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:16.260630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '999b7fe28f1b491f8c7e740f2b5f4fc0', 'request_id': 'req-3f1a5146-ec5c-4cde-b7f4-526c23dce112'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.324978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '999b7fe28f1b491f8c7e740f2b5f4fc0', 'request_id': 'req-3f1a5146-ec5c-4cde-b7f4-526c23dce112'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.332968 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '999b7fe28f1b491f8c7e740f2b5f4fc0', 'request_id': 'req-3f1a5146-ec5c-4cde-b7f4-526c23dce112'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.345792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] The token cache is being invalidate because project 999b7fe28f1b491f8c7e740f2b5f4fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:16.346404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.347042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3f1a5146-ec5c-4cde-b7f4-526c23dce112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.351825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 941/1893] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:16 2022] DELETE /identity/v3/projects/999b7fe28f1b491f8c7e740f2b5f4fc0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:16.351825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348784d-e731-4481-856d-ea593889b8ec None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.351825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348784d-e731-4481-856d-ea593889b8ec None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.351825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7348784d-e731-4481-856d-ea593889b8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.375475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d4754b6a66b443b90c89cb1e48e7846'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.377174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d4754b6a66b443b90c89cb1e48e7846'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.378795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7348784d-e731-4481-856d-ea593889b8ec None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:16.380004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7348784d-e731-4481-856d-ea593889b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:16.395052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d4754b6a66b443b90c89cb1e48e7846'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.396148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d4754b6a66b443b90c89cb1e48e7846'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.452319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 942/1894] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:16.453115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348784d-e731-4481-856d-ea593889b8ec None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:16.457083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7348784d-e731-4481-856d-ea593889b8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:16.470466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7348784d-e731-4481-856d-ea593889b8ec None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:16.480581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:16.480581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.480581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.480581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] PATH_INFO: `/v3/users/ca25b913901c4e8ab75c78a5662d727f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.480874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca25b913901c4e8ab75c78a5662d727f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:16.480874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:16.678994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d4754b6a66b443b90c89cb1e48e7846'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.695662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 953/1895] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:16 2022] DELETE /identity/v3/users/4d4754b6a66b443b90c89cb1e48e7846 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:16.696881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:16.807052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca25b913901c4e8ab75c78a5662d727f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.823152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f332625-da3d-4ec4-b5d4-3122e73257da admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:16.833318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:16.835381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.837091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.837787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.838725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:16.841033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:16.842946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:16.857375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 954/1896] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:16.862771 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:16.875978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d89f8e-2031-4fcf-8760-6e30a6c26ba5 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:16.880905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:16.881603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:16.882013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:16.882360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:16.883098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:16.885114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:16.897579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca25b913901c4e8ab75c78a5662d727f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.911510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca25b913901c4e8ab75c78a5662d727f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.925175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca25b913901c4e8ab75c78a5662d727f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.926058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca25b913901c4e8ab75c78a5662d727f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:16.936661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 943/1897] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:16 2022] DELETE /identity/v3/users/ca25b913901c4e8ab75c78a5662d727f => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:17.005164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 955/1898] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:16 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:17.006733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.008237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:17.092882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf70e1c-976d-4187-ab5b-b0ce0252d0c8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.116326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:17.165939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.166757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.167044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.167317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.167986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.170008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.297147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 944/1899] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:17 2022] POST /identity/v3/users => generated 291 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:17.302321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.322354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69feb34-1725-4508-b521-9bffa4dac987 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.328632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.329727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.334449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.334737 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.335161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.336276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.337203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:17.339124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.352587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 956/1900] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:17.356530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.362025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160b1715-6fdd-4b93-a0bd-0824764e41bc admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.368115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9839a83-4d15-4fe7-ab9d-881b92a7e3ea admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.370487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.371279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.371635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.372660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] PATH_INFO: `/v3/users/9d6b4ae300a045e280f84362c572acf4` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.373400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6b4ae300a045e280f84362c572acf4)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.375455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.376157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.381642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.381642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.381642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.381642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.381642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.393351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 957/1901] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:17 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:17.398191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.434971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942614b4-5f2b-41a1-a77d-d979ce2eb640 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.443096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b87c86-ce90-4dce-99ed-0033f3a36a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.449366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87c86-ce90-4dce-99ed-0033f3a36a85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.449366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87c86-ce90-4dce-99ed-0033f3a36a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.449366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b87c86-ce90-4dce-99ed-0033f3a36a85 admin admin] PATH_INFO: `/v3/projects/f987e1b48a44496b8608c5a5a8953bfc/users/3a4a54f3f9cf494bb6e9cfd5fe6fe51d/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.468124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b87c86-ce90-4dce-99ed-0033f3a36a85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f987e1b48a44496b8608c5a5a8953bfc, user_id=3a4a54f3f9cf494bb6e9cfd5fe6fe51d, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.472671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b87c86-ce90-4dce-99ed-0033f3a36a85 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.618619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 958/1902] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:17 2022] PUT /identity/v3/projects/f987e1b48a44496b8608c5a5a8953bfc/users/3a4a54f3f9cf494bb6e9cfd5fe6fe51d/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:17.622321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddab4c-58e8-4846-9768-f02031280267 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.622611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddab4c-58e8-4846-9768-f02031280267 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.623493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bddab4c-58e8-4846-9768-f02031280267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.653970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3bddab4c-58e8-4846-9768-f02031280267 None None] MFA Rules not processed for user `3a4a54f3f9cf494bb6e9cfd5fe6fe51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:17.655180 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3bddab4c-58e8-4846-9768-f02031280267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:17.718684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 959/1903] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:17.723108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddab4c-58e8-4846-9768-f02031280267 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.778143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6b4ae300a045e280f84362c572acf4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:17.810375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bddab4c-58e8-4846-9768-f02031280267 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.816362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635f8b61-fec8-4eb2-a627-5439c26585ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:17.817068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8b61-fec8-4eb2-a627-5439c26585ea admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.817265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8b61-fec8-4eb2-a627-5439c26585ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.817538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635f8b61-fec8-4eb2-a627-5439c26585ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.818270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8b61-fec8-4eb2-a627-5439c26585ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:17.820261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635f8b61-fec8-4eb2-a627-5439c26585ea admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:17.879349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6b4ae300a045e280f84362c572acf4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:17.887971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6b4ae300a045e280f84362c572acf4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:17.900210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6b4ae300a045e280f84362c572acf4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:17.900955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6b4ae300a045e280f84362c572acf4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:17.906947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 945/1904] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:17 2022] DELETE /identity/v3/users/9d6b4ae300a045e280f84362c572acf4 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:17.907756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:17.909280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:17.952696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 960/1905] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:17 2022] POST /identity/v3/projects => generated 381 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:17.954242 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:17.954604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:17.955016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:17.973250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5397de-7f20-4081-8f64-a1af6c54b6c5 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:17.974564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:17.975782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.028072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.028724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.029005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.029281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] PATH_INFO: `/v3/projects/3d954f8414cf44eea0fbe772902bf204` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.030448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d954f8414cf44eea0fbe772902bf204)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.033035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.039550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 961/1906] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:18.039550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.039550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.052590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea030880-2809-4ab5-bb51-52729ffe1e0e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.058117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.058117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.058346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.058553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.059223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.061224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.166123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d954f8414cf44eea0fbe772902bf204', 'request_id': 'req-31c883e3-8da1-4597-a3a7-81619babd2b0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.181063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 962/1907] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/users => generated 297 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:18.181063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.181063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.193412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29998d09-0028-4be0-a806-fc5d7960af09 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.253221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.253990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.254273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.254546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] PATH_INFO: `/v3/projects/fc893eeedc5c4368af5719391ee49b00` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.255719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc893eeedc5c4368af5719391ee49b00)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.256657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d954f8414cf44eea0fbe772902bf204', 'request_id': 'req-31c883e3-8da1-4597-a3a7-81619babd2b0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.257619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.263222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d954f8414cf44eea0fbe772902bf204', 'request_id': 'req-31c883e3-8da1-4597-a3a7-81619babd2b0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.274992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] The token cache is being invalidate because project 3d954f8414cf44eea0fbe772902bf204 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:18.275277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.275941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.277479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 946/1908] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:17 2022] DELETE /identity/v3/projects/3d954f8414cf44eea0fbe772902bf204 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:18.278327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.279646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.336196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c883e3-8da1-4597-a3a7-81619babd2b0 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.339906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.340755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.341599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.342224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.345122 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.358666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.360930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.371798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 947/1909] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:18.372470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.373818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.386505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf05607a-6d66-42ce-bc86-bc568ffbf5b6 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.389652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc893eeedc5c4368af5719391ee49b00', 'request_id': 'req-2fbe81f1-f232-403f-ab5e-c7a09e890433'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.395973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc893eeedc5c4368af5719391ee49b00', 'request_id': 'req-2fbe81f1-f232-403f-ab5e-c7a09e890433'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.403346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc893eeedc5c4368af5719391ee49b00', 'request_id': 'req-2fbe81f1-f232-403f-ab5e-c7a09e890433'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.449683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461085d-44dc-4a4f-b010-ee065f37c097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.450343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461085d-44dc-4a4f-b010-ee065f37c097 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.450624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461085d-44dc-4a4f-b010-ee065f37c097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.451029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461085d-44dc-4a4f-b010-ee065f37c097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.451735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461085d-44dc-4a4f-b010-ee065f37c097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.453325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461085d-44dc-4a4f-b010-ee065f37c097 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.464790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 948/1910] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:18.465929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930556-5dbf-4d58-9665-fe75086e45c4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.466218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930556-5dbf-4d58-9665-fe75086e45c4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.466939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db930556-5dbf-4d58-9665-fe75086e45c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.487954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-db930556-5dbf-4d58-9665-fe75086e45c4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:18.489543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-db930556-5dbf-4d58-9665-fe75086e45c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.498203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 949/1911] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:18.499004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930556-5dbf-4d58-9665-fe75086e45c4 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.511585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db930556-5dbf-4d58-9665-fe75086e45c4 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.517480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.518208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.518493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.518774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] PATH_INFO: `/v3/projects/51c45bbd940e4904af4bfcf593c61c66/users/5616cff084ae4979b8832bb615dd057a/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.534162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] The token cache is being invalidate because project fc893eeedc5c4368af5719391ee49b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:18.534514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.535156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2fbe81f1-f232-403f-ab5e-c7a09e890433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:18.535884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c45bbd940e4904af4bfcf593c61c66, user_id=5616cff084ae4979b8832bb615dd057a, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.537462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 963/1912] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:18 2022] DELETE /identity/v3/projects/fc893eeedc5c4368af5719391ee49b00 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:18.538474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.538885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be83bf-01a6-4e11-99be-11c6dee380df None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.539168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be83bf-01a6-4e11-99be-11c6dee380df None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.539447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29be83bf-01a6-4e11-99be-11c6dee380df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.563695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-29be83bf-01a6-4e11-99be-11c6dee380df None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:18.564336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-29be83bf-01a6-4e11-99be-11c6dee380df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.574425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 964/1913] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:18.575839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e4f42-27b5-4b5a-a1cf-b8b441e8408d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.576196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e4f42-27b5-4b5a-a1cf-b8b441e8408d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.576546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0e4f42-27b5-4b5a-a1cf-b8b441e8408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.602670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8c0e4f42-27b5-4b5a-a1cf-b8b441e8408d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:18.604087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8c0e4f42-27b5-4b5a-a1cf-b8b441e8408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.612192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 965/1914] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:18.613015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e4f42-27b5-4b5a-a1cf-b8b441e8408d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.622433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0e4f42-27b5-4b5a-a1cf-b8b441e8408d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.627066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5745ecd-4495-4d67-a740-3c6602c42b12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.627704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745ecd-4495-4d67-a740-3c6602c42b12 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.630809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745ecd-4495-4d67-a740-3c6602c42b12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.630809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5745ecd-4495-4d67-a740-3c6602c42b12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.630809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5745ecd-4495-4d67-a740-3c6602c42b12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:18.630809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5745ecd-4495-4d67-a740-3c6602c42b12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.630809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5745ecd-4495-4d67-a740-3c6602c42b12 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.644673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 966/1915] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:18.646017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57360e-f3c1-4a6a-975e-d92015a8ca2a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.646789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57360e-f3c1-4a6a-975e-d92015a8ca2a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.647073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c57360e-f3c1-4a6a-975e-d92015a8ca2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.668003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9c57360e-f3c1-4a6a-975e-d92015a8ca2a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:18.669205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9c57360e-f3c1-4a6a-975e-d92015a8ca2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.678554 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 967/1916] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:18.682202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57360e-f3c1-4a6a-975e-d92015a8ca2a None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.692415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c57360e-f3c1-4a6a-975e-d92015a8ca2a None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.699075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.699075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.699075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.699075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.699441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.703428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.706037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:18.709699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 950/1917] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:18 2022] PUT /identity/v3/projects/51c45bbd940e4904af4bfcf593c61c66/users/5616cff084ae4979b8832bb615dd057a/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:18.711618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.785819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bc229-07b1-4ca0-b3d3-8db0f2a564b8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.790896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.791549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.791953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.792436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.793030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:18.793455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.795125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.809885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 951/1918] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:18.810733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.812512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:18.826736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763731a-faf9-4bd3-a891-6b35d73f60c8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.831525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.832672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.832672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.832886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.833505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.835291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.842719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 968/1919] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/projects => generated 375 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:18.842719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.852188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 952/1920] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:18.852188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:18.865443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a36977-0b9c-46f1-998d-d5d8be96919b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.935346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c1415-73ef-417b-988e-a181276496ae admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:18.948002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.948718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.949350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.949692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.950471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.952471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:18.979963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:18.983667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:18.984135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:18.984565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:18.985445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:18.987562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.061586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 969/1921] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/projects => generated 369 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:19.061844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.089055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 953/1922] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:18 2022] POST /identity/v3/users => generated 288 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:19.089168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.106851 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd82e4cb-f92a-44ba-8392-bf287a12bab0 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.144254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c04e0-694c-4aef-a243-2456dd85f53e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.149634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.155673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.155673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.155673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] PATH_INFO: `/v3/projects/51c45bbd940e4904af4bfcf593c61c66/users/5616cff084ae4979b8832bb615dd057a/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.155673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51c45bbd940e4904af4bfcf593c61c66, user_id=5616cff084ae4979b8832bb615dd057a, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.155673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.167263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 970/1923] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:19 2022] PUT /identity/v3/projects/51c45bbd940e4904af4bfcf593c61c66/users/5616cff084ae4979b8832bb615dd057a/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:19.168397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.169917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.174706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.175332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.175611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.175883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.176539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.178646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.238556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ae014-0f24-4ea6-8538-90061076fa20 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.243496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.244144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.244426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.244702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] PATH_INFO: `/v3/projects/519fa53cd3a642b8bc8fd5e3f424de52` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.245904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] RBAC: Authorizing `identity:delete_project(project_id=519fa53cd3a642b8bc8fd5e3f424de52)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.247958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.272053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 954/1924] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:19 2022] POST /identity/v3/users => generated 285 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:19.273152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.284991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a87fda5-ee21-4129-a924-7708f9c2e8a9 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.289923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6afc97-0ef8-4c8a-a6c2-ced8bcfb67b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.290593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6afc97-0ef8-4c8a-a6c2-ced8bcfb67b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.290943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6afc97-0ef8-4c8a-a6c2-ced8bcfb67b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.291301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6afc97-0ef8-4c8a-a6c2-ced8bcfb67b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.292172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6afc97-0ef8-4c8a-a6c2-ced8bcfb67b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.293860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6afc97-0ef8-4c8a-a6c2-ced8bcfb67b4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.305624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 955/1925] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:19.306912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456843-e756-4a39-81e7-b95441822864 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.307202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456843-e756-4a39-81e7-b95441822864 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.307482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18456843-e756-4a39-81e7-b95441822864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.351098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-18456843-e756-4a39-81e7-b95441822864 None None] MFA Rules not processed for user `5616cff084ae4979b8832bb615dd057a`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:19.352439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-18456843-e756-4a39-81e7-b95441822864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.391149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '519fa53cd3a642b8bc8fd5e3f424de52', 'request_id': 'req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.400351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '519fa53cd3a642b8bc8fd5e3f424de52', 'request_id': 'req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.412989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '519fa53cd3a642b8bc8fd5e3f424de52', 'request_id': 'req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.441896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 956/1926] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:19.442953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456843-e756-4a39-81e7-b95441822864 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.453468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18456843-e756-4a39-81e7-b95441822864 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.507662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] The token cache is being invalidate because project 519fa53cd3a642b8bc8fd5e3f424de52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:19.508964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.509328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.509602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.509941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.510239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.510601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.510929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.512993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.513278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 971/1927] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:19 2022] DELETE /identity/v3/projects/519fa53cd3a642b8bc8fd5e3f424de52 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:19.514368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.516390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.531295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 957/1928] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:19.531295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.533751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.539540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f8893-4e5b-4cb3-bb1d-c168d6d5c27b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.544533 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.545171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.545459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.545739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.546541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.548863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.559238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 972/1929] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:19.562436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.562436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.574789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971bebb-59f2-4e79-943a-5498c2a4fa69 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.579759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.580504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.580791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.581065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] PATH_INFO: `/v3/users/845658c501bb433e9f67e8ad5a60f1a5` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.582276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=845658c501bb433e9f67e8ad5a60f1a5)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.585375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.593498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb0008a-a33c-4365-a2ec-f49570ddf033 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.597711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.598360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.598648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.598921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.600678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.664902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.666332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.675743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 958/1930] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:19.676518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.677907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.690824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3473961-c254-4d82-9db8-64bbde5d7c23 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.695971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.696221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.696505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.696780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.697462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.699159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.713135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 959/1931] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:19.713135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.720825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf6c962-fad6-4e71-9da9-8f53b729db08 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.727319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.728357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.728647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.728937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] PATH_INFO: `/v3/projects/8d5cba8a62a74f44823eff2af4d5e7be/users/c3713a18247f4dd8af55b0631de71a83/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.747648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d5cba8a62a74f44823eff2af4d5e7be, user_id=c3713a18247f4dd8af55b0631de71a83, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.751173 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.827611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845658c501bb433e9f67e8ad5a60f1a5'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.828344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845658c501bb433e9f67e8ad5a60f1a5'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.841324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845658c501bb433e9f67e8ad5a60f1a5'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.842049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845658c501bb433e9f67e8ad5a60f1a5'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.857182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 960/1932] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:19 2022] PUT /identity/v3/projects/8d5cba8a62a74f44823eff2af4d5e7be/users/c3713a18247f4dd8af55b0631de71a83/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:19.858216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:19.861061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:19.933181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4e1cd-9f60-4a3e-a85e-cd8eccdc6b29 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:19.939074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04803acd-a405-4155-84d6-fe76577db06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:19.940416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803acd-a405-4155-84d6-fe76577db06d admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.940700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803acd-a405-4155-84d6-fe76577db06d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.940971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04803acd-a405-4155-84d6-fe76577db06d admin admin] PATH_INFO: `/v3/projects/a8f3605b61554825a567ad2786505038/users/dc378b684bbe4ed9a559b1f118683e69/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.944977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2816c6a8-5bdd-4bbc-90a7-24a81be2b620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845658c501bb433e9f67e8ad5a60f1a5'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:19.961353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803acd-a405-4155-84d6-fe76577db06d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8f3605b61554825a567ad2786505038, user_id=dc378b684bbe4ed9a559b1f118683e69, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:19.961894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 973/1933] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:19 2022] DELETE /identity/v3/users/845658c501bb433e9f67e8ad5a60f1a5 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:19.964349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04803acd-a405-4155-84d6-fe76577db06d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:19.965896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:19.966183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:19.966724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:19.997314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] MFA Rules not processed for user `c3713a18247f4dd8af55b0631de71a83`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:19.998567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:20.077933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 974/1934] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:20.086938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.088462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:20.118892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 961/1935] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:19 2022] PUT /identity/v3/projects/a8f3605b61554825a567ad2786505038/users/dc378b684bbe4ed9a559b1f118683e69/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:20.130955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.131512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.131796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.158620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75235fcd-fd37-4fdf-a52f-c518a3b820c9 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.167714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] MFA Rules not processed for user `dc378b684bbe4ed9a559b1f118683e69`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:20.169070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:20.224903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.225875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.226232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.226587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.256011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 962/1936] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:20 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:20.271175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.273894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:20.325463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.330182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.345815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 975/1937] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:20.390145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f13c3-42e8-4bd6-8862-3b7fe867e413 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.397053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd59ae-0875-4e85-be39-feee1f83c51f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.397249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd59ae-0875-4e85-be39-feee1f83c51f service glance] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.397577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd59ae-0875-4e85-be39-feee1f83c51f service glance] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.398097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd59ae-0875-4e85-be39-feee1f83c51f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.409600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd59ae-0875-4e85-be39-feee1f83c51f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.411280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dd59ae-0875-4e85-be39-feee1f83c51f service glance] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:20.421502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 963/1938] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:20 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:20.458957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.551509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:20.699511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:20.702427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:20.839327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc854479-416e-4b4e-904b-6ab3d1a4a706 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:20.848020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:20.848799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:20.849205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:20.849575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] PATH_INFO: `/v3/projects/a04bc9cc17a94703bf9965c99b42c184` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:20.851362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a04bc9cc17a94703bf9965c99b42c184)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:20.853559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.004032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a04bc9cc17a94703bf9965c99b42c184', 'request_id': 'req-7099fc61-33e7-4c6e-8830-22b6ffb5606b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:21.011182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a04bc9cc17a94703bf9965c99b42c184', 'request_id': 'req-7099fc61-33e7-4c6e-8830-22b6ffb5606b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:21.022899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a04bc9cc17a94703bf9965c99b42c184', 'request_id': 'req-7099fc61-33e7-4c6e-8830-22b6ffb5606b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:21.140428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] The token cache is being invalidate because project a04bc9cc17a94703bf9965c99b42c184 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:21.140864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:21.142130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7099fc61-33e7-4c6e-8830-22b6ffb5606b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:21.147537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 976/1939] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:20 2022] DELETE /identity/v3/projects/a04bc9cc17a94703bf9965c99b42c184 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:21.152419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.154920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.158027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.196994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:21.198623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:21.379987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 964/1940] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:21.397801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da84c-5dcc-444b-8997-e58d4fa2f2de None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.397801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da84c-5dcc-444b-8997-e58d4fa2f2de None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.397801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261da84c-5dcc-444b-8997-e58d4fa2f2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.401222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.403508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:21.497378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-261da84c-5dcc-444b-8997-e58d4fa2f2de None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:21.509597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-261da84c-5dcc-444b-8997-e58d4fa2f2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:21.540986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 977/1941] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:21.552035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261da84c-5dcc-444b-8997-e58d4fa2f2de None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.553986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42986412-78c5-4811-8d03-40a15d409b57 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.560525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5616cff084ae4979b8832bb615dd057a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51c45bbd940e4904af4bfcf593c61c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.561686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.562005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.562285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.563489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.563802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.569367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.585380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 965/1942] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:21.586862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.596432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261da84c-5dcc-444b-8997-e58d4fa2f2de None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.601759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f10b28-0e9d-4652-a8b5-e5a5b274868d tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.607408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.609783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5616cff084ae4979b8832bb615dd057a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51c45bbd940e4904af4bfcf593c61c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.609910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.609991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.610065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.610134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.610297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.610370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.610438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.610505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.610581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.612068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.612183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.635156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 978/1943] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:21.639683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.670958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fe1dd4-fcf6-4365-81d9-ba8524121b68 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.690303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.691353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.691649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.694828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.696030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.699679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.740212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 966/1944] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:21 2022] POST /identity/v3/projects => generated 353 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:21.744509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.813947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05141be-d500-41c8-a05d-4625fa1d23e1 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.818586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5616cff084ae4979b8832bb615dd057a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51c45bbd940e4904af4bfcf593c61c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.819215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.819501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.819779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.820515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:21.820821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.822513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:21.838388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 979/1945] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:21 2022] POST /identity/v3/projects => generated 363 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:21.842375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:21.854687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 967/1946] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:21.916303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d1b3ae-c54b-4cb3-baad-3e5c20404cb7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:21.921600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:21.922449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:21.922809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:21.923185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:21.926933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:21.929947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.069551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 980/1947] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:21 2022] POST /identity/v3/users => generated 282 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:22.074121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.140044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50cab3c-87ed-497b-99a7-6a215f61352c tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.145318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.146010 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.146324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.146631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.147355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.148967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.159374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 968/1948] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:22.163561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.174324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57d4b1-e759-4566-a94f-bbe2b80474c5 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.179222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.179835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.180117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.180392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.181116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.182741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.193052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 981/1949] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:22.197502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.211341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e53b1d-fbc1-4a41-9085-7b16a2963933 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.218743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf45bf-117d-4070-b1a3-96145cdc2247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.220042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf45bf-117d-4070-b1a3-96145cdc2247 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.220506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf45bf-117d-4070-b1a3-96145cdc2247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.220661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf45bf-117d-4070-b1a3-96145cdc2247 admin admin] PATH_INFO: `/v3/projects/cc3d911e2c634688a349b9ded2e435fe/users/7379ccd190c045cdb6d884f14f78def4/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.240974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf45bf-117d-4070-b1a3-96145cdc2247 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc3d911e2c634688a349b9ded2e435fe, user_id=7379ccd190c045cdb6d884f14f78def4, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.243858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf45bf-117d-4070-b1a3-96145cdc2247 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.284350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.353337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 969/1950] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:22 2022] PUT /identity/v3/projects/cc3d911e2c634688a349b9ded2e435fe/users/7379ccd190c045cdb6d884f14f78def4/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:22.364955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237df8b-6f39-4ef5-b499-ded4da9624fc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.365127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237df8b-6f39-4ef5-b499-ded4da9624fc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.365455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237df8b-6f39-4ef5-b499-ded4da9624fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.409054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae4a9be-460c-4eb6-acd2-af585ce76c5d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.424755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b237df8b-6f39-4ef5-b499-ded4da9624fc None None] MFA Rules not processed for user `7379ccd190c045cdb6d884f14f78def4`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:22.426554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b237df8b-6f39-4ef5-b499-ded4da9624fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:22.519182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:22.520695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5616cff084ae4979b8832bb615dd057a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51c45bbd940e4904af4bfcf593c61c66', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.521699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.523054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.523054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] PATH_INFO: `/v3/projects/c3cf23d8551b4be2b5944dccaac47db0` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.523653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c3cf23d8551b4be2b5944dccaac47db0)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.525640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.552879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 970/1951] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:22.554498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237df8b-6f39-4ef5-b499-ded4da9624fc None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.675751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237df8b-6f39-4ef5-b499-ded4da9624fc None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:22.680762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:22.681443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:22.681792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:22.682391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:22.683458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:22.687425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:22.770134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3cf23d8551b4be2b5944dccaac47db0', 'request_id': 'req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:22.776389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3cf23d8551b4be2b5944dccaac47db0', 'request_id': 'req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:22.782698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3cf23d8551b4be2b5944dccaac47db0', 'request_id': 'req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:22.819393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 971/1952] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:22 2022] POST /identity/v3/projects => generated 363 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:22.824210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:22.900360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] The token cache is being invalidate because project c3cf23d8551b4be2b5944dccaac47db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:22.900749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:22.910008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:22.910008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 982/1953] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:22 2022] DELETE /identity/v3/projects/c3cf23d8551b4be2b5944dccaac47db0 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:22.980237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb28fc-43a5-4f18-af44-d602f79ab0c1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.008160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.008866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.009304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.009894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.010542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.012534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.127286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 972/1954] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:22 2022] POST /identity/v3/users => generated 288 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:23.128168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.129788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:23.279821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:23.289128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318cc30-e1b6-4abb-8ce6-0f2ab9b15f89 tempest-VolumeQuotaClassesTest-1114117750 tempest-VolumeQuotaClassesTest-1114117750-project-admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.295232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.296254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.296676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.297117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.298204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.300305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.316992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 983/1955] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:23.318378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.336255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bf01a-e47f-45bd-aa50-1cee9e56f104 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.346532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.347526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.347948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.348357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] PATH_INFO: `/v3/projects/58b048e2dd694ae78297952fb6e7d43f/users/f7773e5f21864d2284ed7bd0eb846c0a/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.377091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b048e2dd694ae78297952fb6e7d43f, user_id=f7773e5f21864d2284ed7bd0eb846c0a, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.380196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.495859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 973/1956] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:23 2022] PUT /identity/v3/projects/58b048e2dd694ae78297952fb6e7d43f/users/f7773e5f21864d2284ed7bd0eb846c0a/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:23.499183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.529243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ee967-4dfb-4981-9405-0f38fb7ecc70 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.609702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b2162-7432-4095-9cf3-135c88e230b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.610519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2162-7432-4095-9cf3-135c88e230b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.610803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2162-7432-4095-9cf3-135c88e230b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.611079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b2162-7432-4095-9cf3-135c88e230b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.611960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b2162-7432-4095-9cf3-135c88e230b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.613886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705b2162-7432-4095-9cf3-135c88e230b2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.625474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 984/1957] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:23.642226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.653349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b4e19e-3ef0-4f6b-9003-696da8a555c1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:23.658277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:23.664428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.664428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.664428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] PATH_INFO: `/v3/projects/58b048e2dd694ae78297952fb6e7d43f/users/f7773e5f21864d2284ed7bd0eb846c0a/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.664428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58b048e2dd694ae78297952fb6e7d43f, user_id=f7773e5f21864d2284ed7bd0eb846c0a, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:23.664855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:23.675955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 974/1958] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:23 2022] PUT /identity/v3/projects/58b048e2dd694ae78297952fb6e7d43f/users/f7773e5f21864d2284ed7bd0eb846c0a/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:23.686770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:23.687060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:23.687509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:23.725195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] MFA Rules not processed for user `f7773e5f21864d2284ed7bd0eb846c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:23.726614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:23.805553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 985/1959] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:23 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:23.919754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:23.923864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:24.000612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15af78-ad9a-4817-8795-097101807852 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.004751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.005888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.005888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.006328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.015941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.017370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.027234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 975/1960] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:23 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:24.339141 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.340705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:24.400752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.409192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23962582-9185-46d8-a162-37051aab1df4 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.411261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d8fa1-f4f5-40b0-bfd3-51429007d5dd None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.416114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6594f2f2-b721-4603-a9f4-147cd00314fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.416114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f2f2-b721-4603-a9f4-147cd00314fd service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.416114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f2f2-b721-4603-a9f4-147cd00314fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.416114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6594f2f2-b721-4603-a9f4-147cd00314fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.416570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6594f2f2-b721-4603-a9f4-147cd00314fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:24.419817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.420486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.420770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.421048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] PATH_INFO: `/v3/users/3a4a54f3f9cf494bb6e9cfd5fe6fe51d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.423123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a4a54f3f9cf494bb6e9cfd5fe6fe51d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.425942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.495167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f2f2-b721-4603-a9f4-147cd00314fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.500889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6594f2f2-b721-4603-a9f4-147cd00314fd service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.507281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 976/1961] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:24.668269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a4a54f3f9cf494bb6e9cfd5fe6fe51d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:24.669037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a4a54f3f9cf494bb6e9cfd5fe6fe51d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:24.684534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a4a54f3f9cf494bb6e9cfd5fe6fe51d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:24.685282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a4a54f3f9cf494bb6e9cfd5fe6fe51d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:24.766991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a4a54f3f9cf494bb6e9cfd5fe6fe51d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:24.782642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 986/1962] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:24 2022] DELETE /identity/v3/users/3a4a54f3f9cf494bb6e9cfd5fe6fe51d => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:24.787337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.787724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.788098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.807814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:24.809221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:24.876694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 977/1963] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:24.898144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:24.898144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:24.950660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7a44f-08c7-42d6-aa2c-feb5f521fc6b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:24.955365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:24.955988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:24.956268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:24.956539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:24.966212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:24.967640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:24.978310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 987/1964] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:25.497784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.499471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:25.513099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9f930c-a651-4152-b800-add2814c9540 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.519445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.520111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.520420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.520697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] PATH_INFO: `/v3/projects/f987e1b48a44496b8608c5a5a8953bfc` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.521912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f987e1b48a44496b8608c5a5a8953bfc)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.523841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:25.726477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f987e1b48a44496b8608c5a5a8953bfc', 'request_id': 'req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:25.836380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f987e1b48a44496b8608c5a5a8953bfc', 'request_id': 'req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:25.850859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f987e1b48a44496b8608c5a5a8953bfc', 'request_id': 'req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:25.858329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] The token cache is being invalidate because project f987e1b48a44496b8608c5a5a8953bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:25.858743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:25.860034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:25.861980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 978/1965] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:25 2022] DELETE /identity/v3/projects/f987e1b48a44496b8608c5a5a8953bfc => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:25.865620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.888486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7763f34-277c-4c4a-9bbd-f0dd258af460 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:25.896526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:25.898181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:25.936941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:25.956192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:25.957208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:25.957706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:25.957920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] PATH_INFO: `/v3/users/5616cff084ae4979b8832bb615dd057a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:25.959674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5616cff084ae4979b8832bb615dd057a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:25.961981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.009798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271c7fe0-17eb-4515-a80b-93d4cd48d1f5 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.009798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.009798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.009798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.010259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] PATH_INFO: `/v3/users/c3713a18247f4dd8af55b0631de71a83` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.010259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3713a18247f4dd8af55b0631de71a83)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.016602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.188944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5616cff084ae4979b8832bb615dd057a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.189604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5616cff084ae4979b8832bb615dd057a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.201957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5616cff084ae4979b8832bb615dd057a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.202637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5616cff084ae4979b8832bb615dd057a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.225821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3713a18247f4dd8af55b0631de71a83'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.322002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-63ab257e-c46c-4742-8fb7-23a8f192a2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5616cff084ae4979b8832bb615dd057a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.335032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 988/1966] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:25 2022] DELETE /identity/v3/users/5616cff084ae4979b8832bb615dd057a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:26.414097 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3713a18247f4dd8af55b0631de71a83'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.423419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3713a18247f4dd8af55b0631de71a83'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.450400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3713a18247f4dd8af55b0631de71a83'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.450400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3713a18247f4dd8af55b0631de71a83'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:26.450986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 979/1967] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:25 2022] DELETE /identity/v3/users/c3713a18247f4dd8af55b0631de71a83 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:26.455689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.455982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.456262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.478490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:26.479741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:26.546402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 989/1968] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:26.557007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.563436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:26.630807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90e6c4f-3584-4348-9fa8-87f855d8ec4c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.636600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.637446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.637934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.638530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.651633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.654545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:26.666624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 980/1969] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:26.885201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:26.935525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:26.938809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:26.954113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd99dcf-a7e1-4a30-8238-96fe33b0c512 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:26.959666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:26.961319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:26.961883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:26.962383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] PATH_INFO: `/v3/projects/51c45bbd940e4904af4bfcf593c61c66` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:26.963742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51c45bbd940e4904af4bfcf593c61c66)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:26.966940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.121860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51c45bbd940e4904af4bfcf593c61c66', 'request_id': 'req-6041a95c-7637-4afd-ae7c-d8d1d2520a32'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.129659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51c45bbd940e4904af4bfcf593c61c66', 'request_id': 'req-6041a95c-7637-4afd-ae7c-d8d1d2520a32'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.136395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51c45bbd940e4904af4bfcf593c61c66', 'request_id': 'req-6041a95c-7637-4afd-ae7c-d8d1d2520a32'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.268070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.269552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:27.270886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] The token cache is being invalidate because project 51c45bbd940e4904af4bfcf593c61c66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:27.271195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.271992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6041a95c-7637-4afd-ae7c-d8d1d2520a32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.277208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 990/1970] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:26 2022] DELETE /identity/v3/projects/51c45bbd940e4904af4bfcf593c61c66 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:27.278591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9da9-21db-4deb-9f96-7fa3ac142bd1 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.284431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9da9-21db-4deb-9f96-7fa3ac142bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.284431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a9da9-21db-4deb-9f96-7fa3ac142bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.284897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c909a636-1e16-432e-89ea-47c0f0d6533c service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.308498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-771a9da9-21db-4deb-9f96-7fa3ac142bd1 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:27.309803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-771a9da9-21db-4deb-9f96-7fa3ac142bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:27.354420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.360437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.360437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.360437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] PATH_INFO: `/v3/projects/8d5cba8a62a74f44823eff2af4d5e7be` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.360437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d5cba8a62a74f44823eff2af4d5e7be)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.360437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.384022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 991/1971] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:27.391960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3aea-4fa4-492d-802c-96ee9aff24db None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.392333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3aea-4fa4-492d-802c-96ee9aff24db None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.392614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde3aea-4fa4-492d-802c-96ee9aff24db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.414621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-1fde3aea-4fa4-492d-802c-96ee9aff24db None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:27.415871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1fde3aea-4fa4-492d-802c-96ee9aff24db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:27.425886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 992/1972] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:27.433854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde3aea-4fa4-492d-802c-96ee9aff24db None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.443025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde3aea-4fa4-492d-802c-96ee9aff24db None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.448065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.448693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.448975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.452177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.452177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:27.452177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.452177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.464013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 993/1973] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:27.468602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.478510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bd0b2c-ddcb-4d01-a6d0-909591aee426 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.483928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.485209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.485513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.485750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.495738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.495738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.505150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d5cba8a62a74f44823eff2af4d5e7be', 'request_id': 'req-7838c8cd-7575-4edd-87eb-6151fd295960'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.625196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d5cba8a62a74f44823eff2af4d5e7be', 'request_id': 'req-7838c8cd-7575-4edd-87eb-6151fd295960'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.632390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d5cba8a62a74f44823eff2af4d5e7be', 'request_id': 'req-7838c8cd-7575-4edd-87eb-6151fd295960'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.637582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 994/1974] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:27 2022] POST /identity/v3/projects => generated 387 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:27.638745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.650573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] The token cache is being invalidate because project 8d5cba8a62a74f44823eff2af4d5e7be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:27.650887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.651817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7838c8cd-7575-4edd-87eb-6151fd295960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:27.653402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 981/1975] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:27 2022] DELETE /identity/v3/projects/8d5cba8a62a74f44823eff2af4d5e7be => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:27.658529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfcaa6-36ab-4da9-9b08-ab8f89c1c9f8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.658817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfcaa6-36ab-4da9-9b08-ab8f89c1c9f8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.659094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabfcaa6-36ab-4da9-9b08-ab8f89c1c9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.682218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-cabfcaa6-36ab-4da9-9b08-ab8f89c1c9f8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:27.683506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-cabfcaa6-36ab-4da9-9b08-ab8f89c1c9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:27.724108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851420-8f1f-44a8-82e9-8adb70b12ee2 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.735913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.739194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.739558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.739797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.740496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.743218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.758921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 982/1976] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:27.768309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9028f9-c388-41ea-822c-cda05ebddf64 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.768593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9028f9-c388-41ea-822c-cda05ebddf64 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.768867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9028f9-c388-41ea-822c-cda05ebddf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.790064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-2d9028f9-c388-41ea-822c-cda05ebddf64 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:27.791283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2d9028f9-c388-41ea-822c-cda05ebddf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:27.796379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:27.813818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 983/1977] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:27.813818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9028f9-c388-41ea-822c-cda05ebddf64 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.816288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9028f9-c388-41ea-822c-cda05ebddf64 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.826894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.827552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.827835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.828733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.829440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:27.829748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.831383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.845621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 984/1978] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:27.854566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 995/1979] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:27 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:27.855827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.865938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.874594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:27.883273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5691f1cd-14c0-4b88-aa4f-6248bd3261be admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.889855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.901559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2fa8d-1cda-4b88-95a8-d2470c1a1f59 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.904868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.905267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.905583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.907045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.912422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.912598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.912598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.912598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.912598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.913318 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.913857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.927752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 996/1980] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:27.933196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.946693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dc11c8-5440-4fee-b3b5-179cac1a02ec admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.954471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:27.955375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:27.956427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:27.956929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:27.957868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:27.959889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:27.978028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 997/1981] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:27.981267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:27.992859 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813ab05-f571-470d-9cd8-f6ba80959e58 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:27.998943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25db323c-a5df-4d3d-b565-91f57332a7ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.000349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db323c-a5df-4d3d-b565-91f57332a7ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.001015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db323c-a5df-4d3d-b565-91f57332a7ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.001598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25db323c-a5df-4d3d-b565-91f57332a7ad admin admin] PATH_INFO: `/v3/projects/1663d14c687c45308fd1aab29e77b62d/users/99f2dd064d8e4dd389869000c5d4ad90/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.020386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db323c-a5df-4d3d-b565-91f57332a7ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1663d14c687c45308fd1aab29e77b62d, user_id=99f2dd064d8e4dd389869000c5d4ad90, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.023303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25db323c-a5df-4d3d-b565-91f57332a7ad admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.049682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 985/1982] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:27 2022] POST /identity/v3/projects => generated 373 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:28.053976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.141407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 998/1983] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:27 2022] PUT /identity/v3/projects/1663d14c687c45308fd1aab29e77b62d/users/99f2dd064d8e4dd389869000c5d4ad90/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:28.144078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aece1-c6c3-407a-b009-9812a07df893 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.144724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aece1-c6c3-407a-b009-9812a07df893 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.145228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619aece1-c6c3-407a-b009-9812a07df893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.159331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2463ec1-051e-4301-a406-a6b2b0236882 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.195290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-619aece1-c6c3-407a-b009-9812a07df893 None None] MFA Rules not processed for user `99f2dd064d8e4dd389869000c5d4ad90`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:28.201493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-619aece1-c6c3-407a-b009-9812a07df893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:28.221407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:28.239092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.240082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.240594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.241138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.242297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.246179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.306284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 999/1984] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:28.319298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aece1-c6c3-407a-b009-9812a07df893 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.333277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619aece1-c6c3-407a-b009-9812a07df893 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.345799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 986/1985] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:28 2022] POST /identity/v3/users => generated 287 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:28.348341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.361393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.362147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.362427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.362702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.363376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.365302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.371804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56116f83-4839-46ec-b732-dde8fd16a466 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.382768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.387624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.387624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.387624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.387624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.387624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.402581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 987/1986] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:28.406763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.418861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3e2693-17ee-4ef3-914a-38eb4687f66f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.425737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.426669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.427132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.427405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.428100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.430196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.447343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 988/1987] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:28.453883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.464965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef8a8f-abfa-4535-82c5-893fbe6f410d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.470505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26cdd37-4b9c-4211-b97d-6b191cd239dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.471132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cdd37-4b9c-4211-b97d-6b191cd239dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.473808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cdd37-4b9c-4211-b97d-6b191cd239dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.473963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1000/1988] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:28 2022] POST /identity/v3/projects => generated 387 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:28.474045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26cdd37-4b9c-4211-b97d-6b191cd239dd admin admin] PATH_INFO: `/v3/projects/46c8382cbd794f248d5e6b71ebf02ee9/users/7eaf1befe60e4038a4247d1c0cce2ffb/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.477655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.498508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cdd37-4b9c-4211-b97d-6b191cd239dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=46c8382cbd794f248d5e6b71ebf02ee9, user_id=7eaf1befe60e4038a4247d1c0cce2ffb, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.502508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26cdd37-4b9c-4211-b97d-6b191cd239dd admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.581002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733317b-784b-46ae-879a-13474f2e8d6b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.587176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.587834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.588119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.588398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.589077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.600015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.608629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 989/1989] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:28 2022] PUT /identity/v3/projects/46c8382cbd794f248d5e6b71ebf02ee9/users/7eaf1befe60e4038a4247d1c0cce2ffb/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:28.610673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.610673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.610950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.642007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:28.645321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:28.716896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 990/1990] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:28.718329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.720284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:28.739850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30298511-1c08-4ed2-9c5d-0165ff4a1ca8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.740344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1001/1991] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:28 2022] POST /identity/v3/users => generated 294 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:28.741178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.747752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:28.748520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.749430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.750476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.750938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] PATH_INFO: `/v3/users/7379ccd190c045cdb6d884f14f78def4` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.752652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7379ccd190c045cdb6d884f14f78def4)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.754840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.821086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa398a-63ec-4016-95a2-0230d29a7ef5 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.897806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.898877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.899339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.899773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.915579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.918236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.930202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1002/1992] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:28.933391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:28.966942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93caa14d-1f36-41e2-a053-74cb60b80b25 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:28.974175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7379ccd190c045cdb6d884f14f78def4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:28.974552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:28.976157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:28.976588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:28.977021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:28.977903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:28.980399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:28.996144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1003/1993] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:28.999828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.011505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359e78fa-ad5a-42ce-9035-f47ccf238d13 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.030244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.031187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.032027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.032027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.032731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.034652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.045191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7379ccd190c045cdb6d884f14f78def4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:29.054966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1004/1994] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:29.056686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.061854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7379ccd190c045cdb6d884f14f78def4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:29.071876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abbe070-18d8-492a-88f8-490d6db806cc admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.083013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d79563-82f4-4263-a2e9-8cd0687903c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.083768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79563-82f4-4263-a2e9-8cd0687903c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.084135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79563-82f4-4263-a2e9-8cd0687903c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.084488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d79563-82f4-4263-a2e9-8cd0687903c7 admin admin] PATH_INFO: `/v3/projects/c175827f1d0f4933b9803f3865466350/users/123aee6023374d29b22f197d9c7c4bac/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.096724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7379ccd190c045cdb6d884f14f78def4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:29.097537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3ab78db5-883e-4897-ba82-104cda836a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7379ccd190c045cdb6d884f14f78def4'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:29.129197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d79563-82f4-4263-a2e9-8cd0687903c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c175827f1d0f4933b9803f3865466350, user_id=123aee6023374d29b22f197d9c7c4bac, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.133041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d79563-82f4-4263-a2e9-8cd0687903c7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.137698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 991/1995] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:28 2022] DELETE /identity/v3/users/7379ccd190c045cdb6d884f14f78def4 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:29.142687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.143082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.143463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.170976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:29.172490 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:29.260377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1005/1996] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:29 2022] PUT /identity/v3/projects/c175827f1d0f4933b9803f3865466350/users/123aee6023374d29b22f197d9c7c4bac/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:29.263791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 992/1997] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:29.274082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.274923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.275866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.282284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.286118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:29.335058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] MFA Rules not processed for user `123aee6023374d29b22f197d9c7c4bac`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:29.338766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:29.391656 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026f2e41-ead5-4410-a2ca-89552dd7cb4c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.424473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1006/1998] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:29.430613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.434657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:29.465528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.466203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.466483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.466756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.512316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b6313a-be6b-4ff0-a4eb-83880c20fe1c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.518365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.519010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.519297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.519685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.520598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.522729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.536207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.537911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.548358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 993/1999] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:29.692492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1007/2000] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:29 2022] POST /identity/v3/projects => generated 387 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:29.694210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.705247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d95d311-1a57-4fcb-858c-1fdfc12bf73d service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.778822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.779527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.779876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.780230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.780956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.783644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:29.942570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 994/2001] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:29 2022] POST /identity/v3/users => generated 300 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:29.947208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:29.968285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebfa46-67ba-4647-897e-55f66b7ceec1 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:29.982698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:29.982698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:29.982698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:29.983275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:29.996876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:29.999116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.013082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1008/2002] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:30.018466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.027151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:30.034424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec492c-0597-4427-a233-c19416a431e2 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.039327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.040247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.040666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.041038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] PATH_INFO: `/v3/projects/5d29ed82ffd54de1ba9916d07c7a4d8f/users/c975540d44e24b95b0f37b16883dfec4/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.058128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d29ed82ffd54de1ba9916d07c7a4d8f, user_id=c975540d44e24b95b0f37b16883dfec4, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.060844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.084249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:30.152176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.166320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.188139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 995/2003] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:30 2022] PUT /identity/v3/projects/5d29ed82ffd54de1ba9916d07c7a4d8f/users/c975540d44e24b95b0f37b16883dfec4/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:30.189249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7b91be-6203-4ead-8217-d16e35f56d47 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.192793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.264049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.264703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.264983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.265255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] PATH_INFO: `/v3/projects/cc3d911e2c634688a349b9ded2e435fe` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.266489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc3d911e2c634688a349b9ded2e435fe)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.268435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.268630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c947ae-4120-450e-9b4c-7f99001fbe2a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.273442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.274090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.274369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.274645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.275340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.276939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.288279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 996/2004] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:30.292290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.303195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf7e5-a1f3-465d-9c2b-eb380b3e427a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.309841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa26d95-23d7-4f26-a686-0f7a2886157c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.310533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26d95-23d7-4f26-a686-0f7a2886157c admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.310831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26d95-23d7-4f26-a686-0f7a2886157c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.311099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa26d95-23d7-4f26-a686-0f7a2886157c admin admin] PATH_INFO: `/v3/projects/5d29ed82ffd54de1ba9916d07c7a4d8f/users/c975540d44e24b95b0f37b16883dfec4/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.313664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa26d95-23d7-4f26-a686-0f7a2886157c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d29ed82ffd54de1ba9916d07c7a4d8f, user_id=c975540d44e24b95b0f37b16883dfec4, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.316367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa26d95-23d7-4f26-a686-0f7a2886157c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.326797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 997/2005] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:30 2022] PUT /identity/v3/projects/5d29ed82ffd54de1ba9916d07c7a4d8f/users/c975540d44e24b95b0f37b16883dfec4/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:30.337618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.337974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.338253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.368120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] MFA Rules not processed for user `c975540d44e24b95b0f37b16883dfec4`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:30.369098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.411473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc3d911e2c634688a349b9ded2e435fe', 'request_id': 'req-0850cca6-0c07-440e-82e6-7f4ddc048272'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.417200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc3d911e2c634688a349b9ded2e435fe', 'request_id': 'req-0850cca6-0c07-440e-82e6-7f4ddc048272'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.424676 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc3d911e2c634688a349b9ded2e435fe', 'request_id': 'req-0850cca6-0c07-440e-82e6-7f4ddc048272'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.438570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 998/2006] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:30.449430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.450813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.528910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb969ea8-6e83-474a-bc13-5752c99cf478 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.529390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] The token cache is being invalidate because project cc3d911e2c634688a349b9ded2e435fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:30.529390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.529390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.529390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1009/2007] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:30 2022] DELETE /identity/v3/projects/cc3d911e2c634688a349b9ded2e435fe => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:30.529390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.529804 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.573502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9b0c8f-2059-446a-9f8e-a2261b45f7ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.574221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b0c8f-2059-446a-9f8e-a2261b45f7ba service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.575101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b0c8f-2059-446a-9f8e-a2261b45f7ba service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.575389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9b0c8f-2059-446a-9f8e-a2261b45f7ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.577344 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ab9b0c8f-2059-446a-9f8e-a2261b45f7ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.601645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0850cca6-0c07-440e-82e6-7f4ddc048272 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.608377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.610071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.617500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.617500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] PATH_INFO: `/v3/users/f7773e5f21864d2284ed7bd0eb846c0a` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.617500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7773e5f21864d2284ed7bd0eb846c0a)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.618498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.648379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b0c8f-2059-446a-9f8e-a2261b45f7ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.650060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9b0c8f-2059-446a-9f8e-a2261b45f7ba service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.660499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 999/2008] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:30.678864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.679181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.679464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.716892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] MFA Rules not processed for user `7eaf1befe60e4038a4247d1c0cce2ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:30.719485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.814028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1000/2009] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:30.820713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7773e5f21864d2284ed7bd0eb846c0a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.822315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7773e5f21864d2284ed7bd0eb846c0a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.825661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:30.827188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.839847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8a052-96ec-411c-85d2-cd14736dfe52 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:30.844544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:30.844861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7773e5f21864d2284ed7bd0eb846c0a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.845545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:30.845654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7773e5f21864d2284ed7bd0eb846c0a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.845883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:30.846163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:30.848512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:30.855638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:30.861080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:30.862644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:30.871867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1001/2010] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:30.921991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d3f1d5ca-b4cd-4b05-917e-157f022d89a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7773e5f21864d2284ed7bd0eb846c0a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:30.940987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1010/2011] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:30 2022] DELETE /identity/v3/users/f7773e5f21864d2284ed7bd0eb846c0a => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:31.525717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:31.527167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:31.542119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f70361-7723-44b6-9de4-812c5823f26c service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:31.550581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:31.607660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:31.608307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.608591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.608868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] PATH_INFO: `/v3/projects/58b048e2dd694ae78297952fb6e7d43f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.610685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58b048e2dd694ae78297952fb6e7d43f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:31.612724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:31.770270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58b048e2dd694ae78297952fb6e7d43f', 'request_id': 'req-ce608557-6949-4d76-ab2f-b031b9e50877'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:31.849661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58b048e2dd694ae78297952fb6e7d43f', 'request_id': 'req-ce608557-6949-4d76-ab2f-b031b9e50877'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:31.855797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58b048e2dd694ae78297952fb6e7d43f', 'request_id': 'req-ce608557-6949-4d76-ab2f-b031b9e50877'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:31.868461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] The token cache is being invalidate because project 58b048e2dd694ae78297952fb6e7d43f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:31.868774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:31.869435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ce608557-6949-4d76-ab2f-b031b9e50877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:31.871113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1002/2012] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:31 2022] DELETE /identity/v3/projects/58b048e2dd694ae78297952fb6e7d43f => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:31.876626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cb2e-6ea7-45ba-80a1-e54643a03cf3 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.877127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cb2e-6ea7-45ba-80a1-e54643a03cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.877342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd1cb2e-6ea7-45ba-80a1-e54643a03cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.896989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7dd1cb2e-6ea7-45ba-80a1-e54643a03cf3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:31.898238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7dd1cb2e-6ea7-45ba-80a1-e54643a03cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:31.973791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1011/2013] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:31.977956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:31.982546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:31.982546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:31.998915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:32.001215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:32.017046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1003/2014] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:32.021273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1cb2e-6ea7-45ba-80a1-e54643a03cf3 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.031042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.031346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd1cb2e-6ea7-45ba-80a1-e54643a03cf3 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.032402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:32.036172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.036889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.037175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.037662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.038405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:32.038704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.040314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.052644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1012/2015] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:32.056904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.067078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7960b92d-e97c-4fa5-abb3-d8032c8ca6e9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.072367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.072972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.073255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.073531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.074230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.076127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.090642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42a4493-4185-421b-b23b-d62fb352848f None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.094681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.095306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.095589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.095863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.097658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:32.161745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.163224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.173565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1004/2016] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:32.215258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1013/2017] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:32 2022] POST /identity/v3/projects => generated 387 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:32.221312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.231184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f927d9-f217-46e5-8be3-00ab9d19892e service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.297381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.298044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.298320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.298622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.299289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.301271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.436217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1005/2018] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:32 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:32.440315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.450465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f769f3-9a2d-43cb-bcd9-97d0882fdb14 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.454948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.455548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.455825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.456097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.456781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.458418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.473356 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1014/2019] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:32.476327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.487025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af849946-da4f-4913-935e-ac6cb0a3ec84 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.493027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8244dce-24a1-4133-8cf4-48c2175cbab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.493667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244dce-24a1-4133-8cf4-48c2175cbab1 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.493974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244dce-24a1-4133-8cf4-48c2175cbab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.494246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8244dce-24a1-4133-8cf4-48c2175cbab1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.494930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8244dce-24a1-4133-8cf4-48c2175cbab1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.496522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8244dce-24a1-4133-8cf4-48c2175cbab1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.506733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1006/2020] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:32.510992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.521272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5875dd-2cd0-4190-ba81-cf919ff9c4b9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.526000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.526679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.526961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.527235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] PATH_INFO: `/v3/projects/a66443a277ab4ed8ae9a8f59a042b6b4/users/00a0beab8e5f4703acd6eef99f598dcc/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.543751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a66443a277ab4ed8ae9a8f59a042b6b4, user_id=00a0beab8e5f4703acd6eef99f598dcc, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.547117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.653132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1015/2021] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:32 2022] PUT /identity/v3/projects/a66443a277ab4ed8ae9a8f59a042b6b4/users/00a0beab8e5f4703acd6eef99f598dcc/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:32.664088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c7de-a917-4811-afd8-a792725e0672 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.664372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c7de-a917-4811-afd8-a792725e0672 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.664642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1c7de-a917-4811-afd8-a792725e0672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.693072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-49e1c7de-a917-4811-afd8-a792725e0672 None None] MFA Rules not processed for user `00a0beab8e5f4703acd6eef99f598dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:32.694309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-49e1c7de-a917-4811-afd8-a792725e0672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:32.763876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1007/2022] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:32.768797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.850716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17913566-cc19-4fe0-a3a7-251755dd2e39 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:32.860592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:32.861247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.861678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.861986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.862674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:32.864603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:32.966967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb8a1f-912f-490c-bf49-738ecd7fabf0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:32.967732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb8a1f-912f-490c-bf49-738ecd7fabf0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:32.967812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb8a1f-912f-490c-bf49-738ecd7fabf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:32.980660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1016/2023] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:32 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:32.984235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:32.988331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-5bdb8a1f-912f-490c-bf49-738ecd7fabf0 None None] MFA Rules not processed for user `7eaf1befe60e4038a4247d1c0cce2ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:32.989607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5bdb8a1f-912f-490c-bf49-738ecd7fabf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:32.998353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.061021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cbb342-603b-4333-9474-61d6a4c2637f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.066848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1008/2024] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:33.069668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.070362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.070645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.070945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.071632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.073789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.107566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:33.176628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1017/2025] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:32 2022] POST /identity/v3/users => generated 300 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:33.182281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb8a1f-912f-490c-bf49-738ecd7fabf0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.194410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb8a1f-912f-490c-bf49-738ecd7fabf0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.199785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.200670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.200864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.201217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.202027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.204249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.218950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1009/2026] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:33.220502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.237498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300a0820-bdcf-4276-a6b6-ae7f2c4524e9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.242511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.243194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.243475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.243747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] PATH_INFO: `/v3/projects/d582a52d1a204d1a885a80812e8b3823/users/cb4752f8052a48538d723ef18daed551/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.260265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d582a52d1a204d1a885a80812e8b3823, user_id=cb4752f8052a48538d723ef18daed551, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.263218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.364937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1018/2027] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:33 2022] PUT /identity/v3/projects/d582a52d1a204d1a885a80812e8b3823/users/cb4752f8052a48538d723ef18daed551/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:33.368939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.380414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f1cd5-fa3b-4dee-9d4c-7a3c3d0ae17a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.443316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859a207-0096-4697-8c95-02edbf965665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.443949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a207-0096-4697-8c95-02edbf965665 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.444249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a207-0096-4697-8c95-02edbf965665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.444488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a207-0096-4697-8c95-02edbf965665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.445172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859a207-0096-4697-8c95-02edbf965665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.446807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5859a207-0096-4697-8c95-02edbf965665 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.458435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1010/2028] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:33.462932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.476618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc26e710-f6e9-4554-ae5a-76f0734c000f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.488450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.489307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.491101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.491394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] PATH_INFO: `/v3/projects/d582a52d1a204d1a885a80812e8b3823/users/cb4752f8052a48538d723ef18daed551/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.494365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=d582a52d1a204d1a885a80812e8b3823, user_id=cb4752f8052a48538d723ef18daed551, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.496750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.509245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1019/2029] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:33 2022] PUT /identity/v3/projects/d582a52d1a204d1a885a80812e8b3823/users/cb4752f8052a48538d723ef18daed551/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:33.520530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc913-5e80-4da2-9bcb-0097b9cec576 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.521253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc913-5e80-4da2-9bcb-0097b9cec576 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.522631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99fc913-5e80-4da2-9bcb-0097b9cec576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.565298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b99fc913-5e80-4da2-9bcb-0097b9cec576 None None] MFA Rules not processed for user `cb4752f8052a48538d723ef18daed551`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:33.566535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b99fc913-5e80-4da2-9bcb-0097b9cec576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:33.638674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1011/2030] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:33.650686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.707320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ea9e7f-a6c6-4266-94ef-40ffee32c7ea admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.711608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db650530-36ec-4b25-a7cb-e4670903f4fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.712239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db650530-36ec-4b25-a7cb-e4670903f4fc service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.712561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db650530-36ec-4b25-a7cb-e4670903f4fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.712838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db650530-36ec-4b25-a7cb-e4670903f4fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.723250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db650530-36ec-4b25-a7cb-e4670903f4fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.724681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db650530-36ec-4b25-a7cb-e4670903f4fc service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:33.735090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1020/2031] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:33.801695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc913-5e80-4da2-9bcb-0097b9cec576 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:33.883750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99fc913-5e80-4da2-9bcb-0097b9cec576 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:33.888477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:33.889157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:33.889438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:33.889714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] PATH_INFO: `/v3/users/00a0beab8e5f4703acd6eef99f598dcc` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:33.893111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a0beab8e5f4703acd6eef99f598dcc)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:33.895461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.190140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:34.234791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a0beab8e5f4703acd6eef99f598dcc'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:34.315884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a0beab8e5f4703acd6eef99f598dcc'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:34.324459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a0beab8e5f4703acd6eef99f598dcc'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:34.338484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a0beab8e5f4703acd6eef99f598dcc'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:34.339280 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a0beab8e5f4703acd6eef99f598dcc'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:34.346443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1012/2032] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:33 2022] DELETE /identity/v3/users/00a0beab8e5f4703acd6eef99f598dcc => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:34.350683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.351183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.351430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.382799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:34.384049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:34.445001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1021/2033] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:34.454441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:34.458543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:34.515688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67177526-b919-405f-9a58-8300f1da04e2 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:34.519185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:34.519942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:34.520225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:34.520495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:34.529949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:34.532347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:34.556195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1013/2034] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:35.067008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.068481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:35.080890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f6e58-4fb2-4318-b19a-bc337326babf None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.086488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.087225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.087581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.087935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] PATH_INFO: `/v3/projects/a66443a277ab4ed8ae9a8f59a042b6b4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.089216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a66443a277ab4ed8ae9a8f59a042b6b4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.091181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.237177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a66443a277ab4ed8ae9a8f59a042b6b4', 'request_id': 'req-1605e321-86ff-4c3c-9dce-2d1ca4112acb'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.242673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a66443a277ab4ed8ae9a8f59a042b6b4', 'request_id': 'req-1605e321-86ff-4c3c-9dce-2d1ca4112acb'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.248858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a66443a277ab4ed8ae9a8f59a042b6b4', 'request_id': 'req-1605e321-86ff-4c3c-9dce-2d1ca4112acb'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.415831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] The token cache is being invalidate because project a66443a277ab4ed8ae9a8f59a042b6b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:35.415831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.415831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.415831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1022/2035] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:35 2022] DELETE /identity/v3/projects/a66443a277ab4ed8ae9a8f59a042b6b4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:35.419529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:35.430886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451619e-991e-457b-8254-b6cc5dd23742 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:35.494205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:35.494856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:35.495128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:35.495566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] PATH_INFO: `/v3/users/cb4752f8052a48538d723ef18daed551` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:35.496886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb4752f8052a48538d723ef18daed551)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:35.500265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:35.782800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb4752f8052a48538d723ef18daed551'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.866787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb4752f8052a48538d723ef18daed551'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.869480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:35.890907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb4752f8052a48538d723ef18daed551'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.907018 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb4752f8052a48538d723ef18daed551'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.907866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-529d6787-d8ae-419d-a142-5a5bf741ecda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb4752f8052a48538d723ef18daed551'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:35.916410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1014/2036] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:35 2022] DELETE /identity/v3/users/cb4752f8052a48538d723ef18daed551 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:36.496481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.498048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:36.511099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605e321-86ff-4c3c-9dce-2d1ca4112acb admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.568047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.568781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.569063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.569340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] PATH_INFO: `/v3/projects/d582a52d1a204d1a885a80812e8b3823` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.570670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d582a52d1a204d1a885a80812e8b3823)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.572695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:36.609620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:36.729926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd582a52d1a204d1a885a80812e8b3823', 'request_id': 'req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:36.735900 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd582a52d1a204d1a885a80812e8b3823', 'request_id': 'req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:36.741986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd582a52d1a204d1a885a80812e8b3823', 'request_id': 'req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:36.834968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] The token cache is being invalidate because project d582a52d1a204d1a885a80812e8b3823 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:36.835253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:36.835904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-94d1f4a7-82c9-42ca-bbd4-10fc2834f15e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:36.837446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1023/2037] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:36 2022] DELETE /identity/v3/projects/d582a52d1a204d1a885a80812e8b3823 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:36.842837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff7e11-e30d-4df7-968d-f400d399fecf None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.843269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff7e11-e30d-4df7-968d-f400d399fecf None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.843393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff7e11-e30d-4df7-968d-f400d399fecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.862651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-13ff7e11-e30d-4df7-968d-f400d399fecf None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:36.863836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-13ff7e11-e30d-4df7-968d-f400d399fecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:36.923062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1015/2038] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:36.931196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f1e1c-ad56-435e-a72c-639cbf2a8dda None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.931487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f1e1c-ad56-435e-a72c-639cbf2a8dda None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.931765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f1e1c-ad56-435e-a72c-639cbf2a8dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.954249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ea1f1e1c-ad56-435e-a72c-639cbf2a8dda None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:36.955508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ea1f1e1c-ad56-435e-a72c-639cbf2a8dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:36.965795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1024/2039] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:36.970359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff7e11-e30d-4df7-968d-f400d399fecf None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:36.982436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff7e11-e30d-4df7-968d-f400d399fecf None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:36.986932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:36.987562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:36.987840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:36.988249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:36.988946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:36.989374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:36.991090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.005709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1016/2040] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:37.009966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f1e1c-ad56-435e-a72c-639cbf2a8dda None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.020164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f1e1c-ad56-435e-a72c-639cbf2a8dda None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.025116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.025740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.026066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.026398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.027065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.029123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.188313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1025/2041] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:37 2022] POST /identity/v3/projects => generated 409 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:37.189731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.204945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76ab12-681c-4762-bd4d-06af6ba72924 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.297726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.298389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.298823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.298950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.299608 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.301533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.428409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.430166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:37.441609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1017/2042] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:37 2022] POST /identity/v3/users => generated 305 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:37.446034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.456622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631359f7-b9d5-4838-8bdb-eaa5c9307454 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.461850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.462962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.462962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.463153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.463690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.465324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.478336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1018/2043] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:37.482501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.492810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd712ff1-6ce0-46fa-b47f-1c60bf01baec admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.497510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.498159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.498476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.498753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.499945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.500083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ca7c1-4076-444e-be6f-551132d7e22d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.501611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.503802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ec4d0-db48-46b1-8711-76c4190b1029 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.504415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec4d0-db48-46b1-8711-76c4190b1029 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.504692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec4d0-db48-46b1-8711-76c4190b1029 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.504967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec4d0-db48-46b1-8711-76c4190b1029 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.507291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-985ec4d0-db48-46b1-8711-76c4190b1029 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:37.512249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1019/2044] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:37.518521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.528652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e7eb3-21a3-463f-8428-856c019320d0 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.533648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.534350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.534630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.534905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] PATH_INFO: `/v3/projects/d63ef585555847d39b0b614ae7d1aab2/users/aaad5751980f42c5bec24830d93d063d/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.549342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63ef585555847d39b0b614ae7d1aab2, user_id=aaad5751980f42c5bec24830d93d063d, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.552154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.568068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ec4d0-db48-46b1-8711-76c4190b1029 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.569531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ec4d0-db48-46b1-8711-76c4190b1029 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:37.579671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1026/2045] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:37.767036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1020/2046] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:37 2022] PUT /identity/v3/projects/d63ef585555847d39b0b614ae7d1aab2/users/aaad5751980f42c5bec24830d93d063d/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:37.777420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4929d-a1dc-4410-a957-f7879610cf2b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.777709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4929d-a1dc-4410-a957-f7879610cf2b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.778028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4929d-a1dc-4410-a957-f7879610cf2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.806448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3ab4929d-a1dc-4410-a957-f7879610cf2b None None] MFA Rules not processed for user `aaad5751980f42c5bec24830d93d063d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:37.807664 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3ab4929d-a1dc-4410-a957-f7879610cf2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:37.861295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:37.874280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1027/2047] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:37.878918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:37.942491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cb4d6-9f03-4922-8833-122d9fddd00e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:37.947188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:37.947808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:37.948090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:37.948371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:37.949070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:37.951052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.050747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1021/2048] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:37 2022] POST /identity/v3/projects => generated 407 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:38.058026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4929d-a1dc-4410-a957-f7879610cf2b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.070819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4929d-a1dc-4410-a957-f7879610cf2b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.133361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.134025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.134306 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.134580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.135267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:38.137501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.287243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1028/2049] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:38 2022] POST /identity/v3/users => generated 310 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:38.291301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.301751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bed44d-64aa-4c24-9cd6-8352bea7dc68 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.306463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.307087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.307362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.307633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.308318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:38.309934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.324159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1022/2050] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:38.326357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.341298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b2e8c-acd0-40db-83a0-e369bcc31885 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.351542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.352274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.352561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.352840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] PATH_INFO: `/v3/projects/68545e066cf14fcca6684290d5234fbb/users/79944b57dc584816a8e0a2594a1e465e/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.375570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68545e066cf14fcca6684290d5234fbb, user_id=79944b57dc584816a8e0a2594a1e465e, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:38.382266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.444458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1029/2051] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:38 2022] PUT /identity/v3/projects/68545e066cf14fcca6684290d5234fbb/users/79944b57dc584816a8e0a2594a1e465e/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:38.448678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.461184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082163b-e518-461e-86b1-dbfa90a3cdd6 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.550773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c11a60-d6ef-4f97-bc9b-47794cea2ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.551458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11a60-d6ef-4f97-bc9b-47794cea2ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.551721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11a60-d6ef-4f97-bc9b-47794cea2ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.552001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c11a60-d6ef-4f97-bc9b-47794cea2ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.552830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11a60-d6ef-4f97-bc9b-47794cea2ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:38.559545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c11a60-d6ef-4f97-bc9b-47794cea2ca4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.575916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1023/2052] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:38.577265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.588788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd5bda-de8b-4cf8-96c3-e33859b95703 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.594493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.595243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.595584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.595922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] PATH_INFO: `/v3/projects/68545e066cf14fcca6684290d5234fbb/users/79944b57dc584816a8e0a2594a1e465e/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.597967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68545e066cf14fcca6684290d5234fbb, user_id=79944b57dc584816a8e0a2594a1e465e, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:38.600672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.617183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1030/2053] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:38 2022] PUT /identity/v3/projects/68545e066cf14fcca6684290d5234fbb/users/79944b57dc584816a8e0a2594a1e465e/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:38.622850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee86d8-bcc5-463e-bead-48332ae5cca0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.623225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee86d8-bcc5-463e-bead-48332ae5cca0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.623593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aee86d8-bcc5-463e-bead-48332ae5cca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.655017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9aee86d8-bcc5-463e-bead-48332ae5cca0 None None] MFA Rules not processed for user `79944b57dc584816a8e0a2594a1e465e`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:38.656816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9aee86d8-bcc5-463e-bead-48332ae5cca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:38.716401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:38.734475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1024/2054] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:38 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:38.741414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:38.743277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:38.803299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce6fbf2-e4c0-4ddb-a7aa-9dc393fb32c3 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:38.807317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:38.807992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:38.808449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:38.808734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:38.822805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:38.824766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:38.835145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1031/2055] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:38 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:39.215371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee86d8-bcc5-463e-bead-48332ae5cca0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:39.226006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aee86d8-bcc5-463e-bead-48332ae5cca0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:39.230223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6420f165-4d6c-47fe-a094-53f1cf3d3342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:39.231149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420f165-4d6c-47fe-a094-53f1cf3d3342 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:39.231576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420f165-4d6c-47fe-a094-53f1cf3d3342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:39.232022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6420f165-4d6c-47fe-a094-53f1cf3d3342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:39.322944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420f165-4d6c-47fe-a094-53f1cf3d3342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:39.327745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6420f165-4d6c-47fe-a094-53f1cf3d3342 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:39.361526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1025/2056] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:39 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:39.673023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:40.584355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.872848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:41.961523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:42.742184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:42.743602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:42.806809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591eff3a-b0b9-4ccf-92d5-6d60f886714e service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:42.811872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:42.812514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:42.812794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:42.813066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] PATH_INFO: `/v3/users/99f2dd064d8e4dd389869000c5d4ad90` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:42.814281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99f2dd064d8e4dd389869000c5d4ad90)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:42.816192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.020008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99f2dd064d8e4dd389869000c5d4ad90'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:43.020679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99f2dd064d8e4dd389869000c5d4ad90'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:43.035225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99f2dd064d8e4dd389869000c5d4ad90'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:43.036419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99f2dd064d8e4dd389869000c5d4ad90'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:43.151574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99f2dd064d8e4dd389869000c5d4ad90'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:43.165345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1032/2057] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:42 2022] DELETE /identity/v3/users/99f2dd064d8e4dd389869000c5d4ad90 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:43.172952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.173410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.173651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.192989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:43.194222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:43.251386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1026/2058] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:43.260860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.262266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:43.321040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6f4555-d471-4a47-9201-fdf28303dab3 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.324717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.325328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.325606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.325911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.334689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.336106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.345711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1033/2059] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:43.351856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.564215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:43.770862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:43.772327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:43.786184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307ed9f-ada2-456c-847b-83b80973e11b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:43.791101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:43.796658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:43.796658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:43.796658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] PATH_INFO: `/v3/projects/1663d14c687c45308fd1aab29e77b62d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:43.796658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1663d14c687c45308fd1aab29e77b62d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:43.797872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:43.923717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1663d14c687c45308fd1aab29e77b62d', 'request_id': 'req-487650be-2e7f-4d99-a261-a62bb49f661d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:43.991197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1663d14c687c45308fd1aab29e77b62d', 'request_id': 'req-487650be-2e7f-4d99-a261-a62bb49f661d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:43.996917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1663d14c687c45308fd1aab29e77b62d', 'request_id': 'req-487650be-2e7f-4d99-a261-a62bb49f661d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.008299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] The token cache is being invalidate because project 1663d14c687c45308fd1aab29e77b62d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:44.008583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.009258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.010855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1027/2060] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:43 2022] DELETE /identity/v3/projects/1663d14c687c45308fd1aab29e77b62d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:44.015496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.025598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8800d2-9a55-45e5-9b53-e629b7c74a6d service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.082736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.084115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.084398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.084680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] PATH_INFO: `/v3/users/123aee6023374d29b22f197d9c7c4bac` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.085903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=123aee6023374d29b22f197d9c7c4bac)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.087870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:44.266576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:44.303594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123aee6023374d29b22f197d9c7c4bac'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.304431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123aee6023374d29b22f197d9c7c4bac'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.319758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123aee6023374d29b22f197d9c7c4bac'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.320506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123aee6023374d29b22f197d9c7c4bac'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.368665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123aee6023374d29b22f197d9c7c4bac'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:44.382170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1034/2061] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:44 2022] DELETE /identity/v3/users/123aee6023374d29b22f197d9c7c4bac => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:44.870841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:44.872247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:44.885917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487650be-2e7f-4d99-a261-a62bb49f661d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:44.943314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:44.943911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:44.944197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:44.944469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] PATH_INFO: `/v3/projects/c175827f1d0f4933b9803f3865466350` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:44.945612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c175827f1d0f4933b9803f3865466350)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:44.947546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.001226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.040419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c175827f1d0f4933b9803f3865466350', 'request_id': 'req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.097496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c175827f1d0f4933b9803f3865466350', 'request_id': 'req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.103270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c175827f1d0f4933b9803f3865466350', 'request_id': 'req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.115633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] The token cache is being invalidate because project c175827f1d0f4933b9803f3865466350 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:45.115921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.116574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.118143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1028/2062] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:44 2022] DELETE /identity/v3/projects/c175827f1d0f4933b9803f3865466350 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:45.122067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:45.123889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:45.137213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ab9c7-bae1-4d8f-bd3a-1d1fb09b9a34 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:45.194991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:45.195631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:45.195908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:45.196177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] PATH_INFO: `/v3/users/c975540d44e24b95b0f37b16883dfec4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:45.197321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c975540d44e24b95b0f37b16883dfec4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:45.199257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:45.254810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:45.419637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c975540d44e24b95b0f37b16883dfec4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.421298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c975540d44e24b95b0f37b16883dfec4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.449881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c975540d44e24b95b0f37b16883dfec4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.454270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c975540d44e24b95b0f37b16883dfec4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.563804 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1fb2dd40-6df1-4d08-a5c1-3c7215b74dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c975540d44e24b95b0f37b16883dfec4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:45.577700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1035/2063] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:45 2022] DELETE /identity/v3/users/c975540d44e24b95b0f37b16883dfec4 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:46.004597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.006069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:46.019675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd9fb8-2c7d-4637-b0b9-3d02f7feb172 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.074268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.074899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.075172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.075442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] PATH_INFO: `/v3/projects/5d29ed82ffd54de1ba9916d07c7a4d8f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.076590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d29ed82ffd54de1ba9916d07c7a4d8f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.079188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.156375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d29ed82ffd54de1ba9916d07c7a4d8f', 'request_id': 'req-0ebd5277-061b-48a2-b844-2790f141092f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:46.196048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:46.223665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d29ed82ffd54de1ba9916d07c7a4d8f', 'request_id': 'req-0ebd5277-061b-48a2-b844-2790f141092f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:46.229697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d29ed82ffd54de1ba9916d07c7a4d8f', 'request_id': 'req-0ebd5277-061b-48a2-b844-2790f141092f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:46.235523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:46.241502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] The token cache is being invalidate because project 5d29ed82ffd54de1ba9916d07c7a4d8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:46.241820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:46.242457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0ebd5277-061b-48a2-b844-2790f141092f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:46.244173 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1029/2064] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:46 2022] DELETE /identity/v3/projects/5d29ed82ffd54de1ba9916d07c7a4d8f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:46.252111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191172c-57ad-4007-b570-750b52fdaf25 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.252339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191172c-57ad-4007-b570-750b52fdaf25 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.252613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191172c-57ad-4007-b570-750b52fdaf25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.271718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b191172c-57ad-4007-b570-750b52fdaf25 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:46.276117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b191172c-57ad-4007-b570-750b52fdaf25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:46.334143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1036/2065] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:46.343182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43ae41-81f6-4885-90f8-bade22b1e659 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.343471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43ae41-81f6-4885-90f8-bade22b1e659 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.343747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa43ae41-81f6-4885-90f8-bade22b1e659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.363541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-fa43ae41-81f6-4885-90f8-bade22b1e659 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:46.364723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fa43ae41-81f6-4885-90f8-bade22b1e659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:46.372710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1030/2066] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:46.377152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191172c-57ad-4007-b570-750b52fdaf25 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.386861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191172c-57ad-4007-b570-750b52fdaf25 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.392571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.393215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.393492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.393877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.394489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:46.394792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.396684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.409050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1037/2067] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:46.413707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43ae41-81f6-4885-90f8-bade22b1e659 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.422930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa43ae41-81f6-4885-90f8-bade22b1e659 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.427754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.428367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.428647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.428923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.429586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.431594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.560553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1031/2068] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:46 2022] POST /identity/v3/projects => generated 397 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:46.560728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.573223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe0683-8562-437b-9e55-a563c5c6c42e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.642640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.643631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.644820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.645253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.645963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.648371 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.736810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.737823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1038/2069] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:46 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:46.748372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2ee0d5-c307-4a63-82cd-505ca1d0a1ef admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.760376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.761017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.761299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.761573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.762309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.763902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.776789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1032/2070] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:46.779122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.789275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa506d-7160-4f65-853e-9fcd2f01199b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.794130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2148373f-2d6e-46b5-a2ba-b1b05c1b24f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.794933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148373f-2d6e-46b5-a2ba-b1b05c1b24f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.795223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148373f-2d6e-46b5-a2ba-b1b05c1b24f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.799889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2148373f-2d6e-46b5-a2ba-b1b05c1b24f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.799889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148373f-2d6e-46b5-a2ba-b1b05c1b24f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.799889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2148373f-2d6e-46b5-a2ba-b1b05c1b24f2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.808684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1039/2071] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:46.813491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:46.824760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bbc05c-c2d8-465c-b4c8-10e13aed435f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:46.831417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:46.831417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.831417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.831417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] PATH_INFO: `/v3/projects/9b15193636c14f5d821c7ae88830f113/users/1f6e7eb8ad464906aa5433a4e7a0bd1b/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.848374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b15193636c14f5d821c7ae88830f113, user_id=1f6e7eb8ad464906aa5433a4e7a0bd1b, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:46.851134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:46.922673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1033/2072] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:46 2022] PUT /identity/v3/projects/9b15193636c14f5d821c7ae88830f113/users/1f6e7eb8ad464906aa5433a4e7a0bd1b/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:46.934245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:46.934537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:46.934816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:46.945822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:46.965440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] MFA Rules not processed for user `1f6e7eb8ad464906aa5433a4e7a0bd1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:46.967175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:47.028578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:47.032636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1040/2073] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:46 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:47.044286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:47.045976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:47.101748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57038223-e7e0-4415-ba14-a2b81fe0015f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:47.105603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb48e1fd-b53b-4c08-bdcb-fe93ce18857a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:47.106264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e1fd-b53b-4c08-bdcb-fe93ce18857a service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:47.106544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e1fd-b53b-4c08-bdcb-fe93ce18857a service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:47.106815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48e1fd-b53b-4c08-bdcb-fe93ce18857a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:47.115509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48e1fd-b53b-4c08-bdcb-fe93ce18857a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:47.116944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb48e1fd-b53b-4c08-bdcb-fe93ce18857a service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:47.125797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1034/2074] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:47 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:47.317181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:47.682738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:47.980606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.340213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.379850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.728387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:48.898624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.340138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.380173 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.566528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.591743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.711154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.739687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.795085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.819627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.888422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.911564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:49.940091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.391489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.483791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:50.991397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.127180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.469500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:51.795753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:52.109801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.112302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:52.181181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66bd741-5fee-4428-879e-f2c5952e3c33 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:52.187068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da97db-0185-42af-8012-37197732f55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:52.187741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da97db-0185-42af-8012-37197732f55d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.188025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da97db-0185-42af-8012-37197732f55d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.188697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55da97db-0185-42af-8012-37197732f55d admin admin] PATH_INFO: `/v3/users/aaad5751980f42c5bec24830d93d063d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.190073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da97db-0185-42af-8012-37197732f55d admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaad5751980f42c5bec24830d93d063d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.192098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55da97db-0185-42af-8012-37197732f55d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:52.372683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaad5751980f42c5bec24830d93d063d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:52.374451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaad5751980f42c5bec24830d93d063d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:52.386699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaad5751980f42c5bec24830d93d063d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:52.387458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaad5751980f42c5bec24830d93d063d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:52.471436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaad5751980f42c5bec24830d93d063d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:52.492230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1041/2075] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:52 2022] DELETE /identity/v3/users/aaad5751980f42c5bec24830d93d063d => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:52.493197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.493690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.494070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.516056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:52.517271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:52.590808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1035/2076] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:52.615547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:52.617265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:52.696389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55da97db-0185-42af-8012-37197732f55d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:52.700280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:52.700916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:52.701195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:52.701501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:52.711822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:52.713274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:52.723909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1042/2077] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:52.854123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:52.968644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.335190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.374583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.458327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.459960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:53.476100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb48c99-7b7c-45a6-8659-e8e7b9d6d405 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.487068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.487068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.487068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.487068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] PATH_INFO: `/v3/projects/d63ef585555847d39b0b614ae7d1aab2` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.487488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63ef585555847d39b0b614ae7d1aab2)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.489357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.637301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63ef585555847d39b0b614ae7d1aab2', 'request_id': 'req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:53.692825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.720820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63ef585555847d39b0b614ae7d1aab2', 'request_id': 'req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:53.728407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63ef585555847d39b0b614ae7d1aab2', 'request_id': 'req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:53.734565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:53.753671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] The token cache is being invalidate because project d63ef585555847d39b0b614ae7d1aab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:53.754238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:53.755060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:53.758554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1036/2078] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:53 2022] DELETE /identity/v3/projects/d63ef585555847d39b0b614ae7d1aab2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:53.766518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:53.787435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bcf6ff-5734-4750-9b3c-340076bf7c64 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:53.853673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:53.854462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:53.854843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:53.855191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] PATH_INFO: `/v3/users/79944b57dc584816a8e0a2594a1e465e` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:53.857217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79944b57dc584816a8e0a2594a1e465e)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:53.859340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:53.892161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.055756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79944b57dc584816a8e0a2594a1e465e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:54.056355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79944b57dc584816a8e0a2594a1e465e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:54.068958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79944b57dc584816a8e0a2594a1e465e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:54.069698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79944b57dc584816a8e0a2594a1e465e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:54.182749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cf17367d-11f9-4efb-a5a8-1564b4f2d428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79944b57dc584816a8e0a2594a1e465e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:54.198026 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1043/2079] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:53 2022] DELETE /identity/v3/users/79944b57dc584816a8e0a2594a1e465e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:54.443606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:54.863211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:54.863842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:54.876967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e853ec-d80a-4fa1-b46a-9ed634ff39ed admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:54.936578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:54.937934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:54.938221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:54.938501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] PATH_INFO: `/v3/projects/68545e066cf14fcca6684290d5234fbb` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:54.939677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] RBAC: Authorizing `identity:delete_project(project_id=68545e066cf14fcca6684290d5234fbb)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:54.941621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.087386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68545e066cf14fcca6684290d5234fbb', 'request_id': 'req-3d8a5947-2a2c-4112-8d6c-822b070f700a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:55.195282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68545e066cf14fcca6684290d5234fbb', 'request_id': 'req-3d8a5947-2a2c-4112-8d6c-822b070f700a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:55.204487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68545e066cf14fcca6684290d5234fbb', 'request_id': 'req-3d8a5947-2a2c-4112-8d6c-822b070f700a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:55.259917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] The token cache is being invalidate because project 68545e066cf14fcca6684290d5234fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:55.263357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:55.263357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3d8a5947-2a2c-4112-8d6c-822b070f700a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:55.265722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1037/2080] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:54 2022] DELETE /identity/v3/projects/68545e066cf14fcca6684290d5234fbb => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:55.271244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893699a6-5625-41c4-8215-165657b853cb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.271801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893699a6-5625-41c4-8215-165657b853cb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.272230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893699a6-5625-41c4-8215-165657b853cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.324165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-893699a6-5625-41c4-8215-165657b853cb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:55.325969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-893699a6-5625-41c4-8215-165657b853cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:55.380420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:55.427472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1044/2081] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:55.439605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac5b1-e5e8-4b3c-a3e7-cd5ce9f8c486 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.439892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac5b1-e5e8-4b3c-a3e7-cd5ce9f8c486 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.440175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fac5b1-e5e8-4b3c-a3e7-cd5ce9f8c486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.473358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e1fac5b1-e5e8-4b3c-a3e7-cd5ce9f8c486 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:55.474759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e1fac5b1-e5e8-4b3c-a3e7-cd5ce9f8c486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:55.487787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1038/2082] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:55.489648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893699a6-5625-41c4-8215-165657b853cb None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.503129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893699a6-5625-41c4-8215-165657b853cb None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.509283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.510567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.510888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.511137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.511848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:55.512203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.514566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.535369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1045/2083] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:25:55.539786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac5b1-e5e8-4b3c-a3e7-cd5ce9f8c486 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.549578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fac5b1-e5e8-4b3c-a3e7-cd5ce9f8c486 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.555707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.555964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.556061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.566155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.566155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.566155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.682689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1039/2084] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:55 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:55.686754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.699142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15076955-72f4-4874-802d-d9b2954a8c11 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.765986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.766611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.766923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.767208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.767890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.769837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.873620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1046/2085] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:55 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:55.876058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.886938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc6c640-6b4e-4ec9-9d1d-b8a39f34fe35 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.891498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.892551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.892844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.893183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.894205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.895815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.906428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1040/2086] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:55.910477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.921171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a96f55-e82e-499e-a034-fa3b5482c67f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.925833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.931667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.931667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.931667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:55.931667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:55.931667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:55.940719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1047/2087] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:55.944827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:55.955113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f3899-edb3-4a77-8421-fac2357a17f1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:55.959806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fefd1-cf08-42f7-b1ed-5afbaea6a762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:55.960462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fefd1-cf08-42f7-b1ed-5afbaea6a762 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:55.961023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fefd1-cf08-42f7-b1ed-5afbaea6a762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:55.961179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fefd1-cf08-42f7-b1ed-5afbaea6a762 admin admin] PATH_INFO: `/v3/projects/939f14aa2cb4430e873c26c437bf24fc/users/4930d0daf6b04f20b825216711921340/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.008075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fefd1-cf08-42f7-b1ed-5afbaea6a762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939f14aa2cb4430e873c26c437bf24fc, user_id=4930d0daf6b04f20b825216711921340, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.008075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fefd1-cf08-42f7-b1ed-5afbaea6a762 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.009994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.012052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:56.025913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3a2912-ffe3-448d-b58f-9a44131e73d9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.030863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.031501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.035179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.035179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] PATH_INFO: `/v3/users/5ec59d1b78e24673b23a49d3efdece1b` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.035179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ec59d1b78e24673b23a49d3efdece1b)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.035536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.121079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1041/2088] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:55 2022] PUT /identity/v3/projects/939f14aa2cb4430e873c26c437bf24fc/users/4930d0daf6b04f20b825216711921340/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:56.132002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f65af8-2c60-484f-a40a-4f4467a268bd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.132286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f65af8-2c60-484f-a40a-4f4467a268bd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.132562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f65af8-2c60-484f-a40a-4f4467a268bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.160982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e4f65af8-2c60-484f-a40a-4f4467a268bd None None] MFA Rules not processed for user `4930d0daf6b04f20b825216711921340`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:56.162131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e4f65af8-2c60-484f-a40a-4f4467a268bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:56.225052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1042/2089] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:56.229485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f65af8-2c60-484f-a40a-4f4467a268bd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.268831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ec59d1b78e24673b23a49d3efdece1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:56.269265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ec59d1b78e24673b23a49d3efdece1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:56.282570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ec59d1b78e24673b23a49d3efdece1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:56.283458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ec59d1b78e24673b23a49d3efdece1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:56.300124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:56.311586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f65af8-2c60-484f-a40a-4f4467a268bd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.317373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.318159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.318492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.318772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.319450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.321552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.424875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ec59d1b78e24673b23a49d3efdece1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:56.438768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1043/2090] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:56 2022] POST /identity/v3/projects => generated 379 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:56.440181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.442086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:56.443152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1048/2091] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:56 2022] DELETE /identity/v3/users/5ec59d1b78e24673b23a49d3efdece1b => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:56.515876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeedd37-3c01-4453-9fb3-dca79b24c249 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.571820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.572448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.572723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.573227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.573918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.575865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.745463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1044/2092] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:56 2022] POST /identity/v3/users => generated 296 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:25:56.749456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.759466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a10d58-004b-4021-87b4-dc14b2517f67 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.764709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.765329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.765620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.765958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.768070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.768536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.777467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.780849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1049/2093] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:56.783046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:56.784718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.796415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cae7a35-d6f3-40cd-b14c-1e64276b8c51 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.801380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.802172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.802522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.802871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] PATH_INFO: `/v3/projects/4e23ab2a68c5475dbed0ae3dc6a80e4d/users/a85f7da3ae9649a389456fe3ab75812b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.808230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d737f63d-0341-4757-b79d-193ab525d584 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:56.818602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:56.819764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:56.820541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:56.821011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] PATH_INFO: `/v3/projects/856b7dde39504ca798827cb9c1b4a4d8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:56.823196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856b7dde39504ca798827cb9c1b4a4d8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.823876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e23ab2a68c5475dbed0ae3dc6a80e4d, user_id=a85f7da3ae9649a389456fe3ab75812b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:56.825705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.826687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:56.932235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1050/2094] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:56 2022] PUT /identity/v3/projects/4e23ab2a68c5475dbed0ae3dc6a80e4d/users/a85f7da3ae9649a389456fe3ab75812b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:56.938876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:56.972424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856b7dde39504ca798827cb9c1b4a4d8', 'request_id': 'req-f944129b-331b-4ccc-8b63-28ae1dc91636'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:56.999199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74480725-8e26-46ff-85c2-b4a6cb93fbe8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.053644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.054283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.054562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.054830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.055507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.057114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.066636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1051/2095] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:57.070703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856b7dde39504ca798827cb9c1b4a4d8', 'request_id': 'req-f944129b-331b-4ccc-8b63-28ae1dc91636'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:57.070839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.076635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856b7dde39504ca798827cb9c1b4a4d8', 'request_id': 'req-f944129b-331b-4ccc-8b63-28ae1dc91636'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:57.080410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc0ca2-6ec7-46de-af70-cea9bb15cf2a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.085192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b5314-3262-4630-8098-1d2e63272024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.085875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5314-3262-4630-8098-1d2e63272024 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.086163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5314-3262-4630-8098-1d2e63272024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.086479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b5314-3262-4630-8098-1d2e63272024 admin admin] PATH_INFO: `/v3/projects/4e23ab2a68c5475dbed0ae3dc6a80e4d/users/a85f7da3ae9649a389456fe3ab75812b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.088246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] The token cache is being invalidate because project 856b7dde39504ca798827cb9c1b4a4d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:25:57.088417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b5314-3262-4630-8098-1d2e63272024 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e23ab2a68c5475dbed0ae3dc6a80e4d, user_id=a85f7da3ae9649a389456fe3ab75812b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.088522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:57.089143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-f944129b-331b-4ccc-8b63-28ae1dc91636 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:57.090702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1045/2096] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:25:56 2022] DELETE /identity/v3/projects/856b7dde39504ca798827cb9c1b4a4d8 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:57.091436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b5314-3262-4630-8098-1d2e63272024 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.096287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e13a06-8f2d-4cc0-848d-8abdc747d42a None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.096573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e13a06-8f2d-4cc0-848d-8abdc747d42a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.096980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e13a06-8f2d-4cc0-848d-8abdc747d42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.108687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1052/2097] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:57 2022] PUT /identity/v3/projects/4e23ab2a68c5475dbed0ae3dc6a80e4d/users/a85f7da3ae9649a389456fe3ab75812b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:57.118478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-f7e13a06-8f2d-4cc0-848d-8abdc747d42a None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:57.119640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f7e13a06-8f2d-4cc0-848d-8abdc747d42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:57.120321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.120619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.120982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.134578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:57.154097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] MFA Rules not processed for user `a85f7da3ae9649a389456fe3ab75812b`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:57.156073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:57.186083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1046/2098] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:57.194183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae7f9-a426-461e-8316-0b5571ced45b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.194839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae7f9-a426-461e-8316-0b5571ced45b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.194969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047ae7f9-a426-461e-8316-0b5571ced45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.215497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-047ae7f9-a426-461e-8316-0b5571ced45b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:57.217878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-047ae7f9-a426-461e-8316-0b5571ced45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:57.227985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1047/2099] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:57.228544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:57.233121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ae7f9-a426-461e-8316-0b5571ced45b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.242597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047ae7f9-a426-461e-8316-0b5571ced45b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.243855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1053/2100] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:57.247496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.248573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.248844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.249105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.249827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:25:57.250141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.251765 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.255093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.256497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:57.265797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1048/2101] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:25:57.268267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.278079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd11891-5a09-4f26-b506-c8c615f193cb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.283309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.283898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.284174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.284443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.285084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.287048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.314720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c75b36-eff8-4a79-8469-922b5246124a None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.318369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.319023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.319299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.319571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.328920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.330428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.339719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1054/2102] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:57.379300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1049/2103] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:25:57 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:57.383670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.394865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa218a4-b41e-4d1d-a873-442a735fe706 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.452915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.453546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.453857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.454136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.454849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.456827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.545906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.611836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1055/2104] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:25:57 2022] POST /identity/v3/users => generated 287 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:25:57.612062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba3232-fbda-4686-a428-1811d115000a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.612881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.614692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff75c2b1-729e-4fc9-bfbc-5f06d470817c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.615312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c2b1-729e-4fc9-bfbc-5f06d470817c service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.615899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c2b1-729e-4fc9-bfbc-5f06d470817c service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.615899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff75c2b1-729e-4fc9-bfbc-5f06d470817c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.617626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ff75c2b1-729e-4fc9-bfbc-5f06d470817c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:57.622618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b82b9-90da-4866-8051-ffb4c6240b31 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.628123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.628735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.629052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.629331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.630085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.631674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.641751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1056/2105] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:25:57.646730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.656576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af7d7-6527-41ea-aaf2-f9364811774c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.661566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.667335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.667335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.667335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.667335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.667335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.676146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1057/2106] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:25:57.679686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75c2b1-729e-4fc9-bfbc-5f06d470817c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.680187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.681135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff75c2b1-729e-4fc9-bfbc-5f06d470817c service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.689727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee49b-e008-4dfe-b389-0bfdd6bbd64b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:57.690420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1050/2107] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:25:57.694464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:57.695111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.695395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.695708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] PATH_INFO: `/v3/projects/cdbe2f82714943548e6396c1f1e66a04/users/c0ad7d9c00bd4378a31f340876d8509f/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.711384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdbe2f82714943548e6396c1f1e66a04, user_id=c0ad7d9c00bd4378a31f340876d8509f, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:57.714126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:57.768330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:57.807733 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1058/2108] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:25:57 2022] PUT /identity/v3/projects/cdbe2f82714943548e6396c1f1e66a04/users/c0ad7d9c00bd4378a31f340876d8509f/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:25:57.817751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:57.818059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:57.818355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:57.846948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] MFA Rules not processed for user `c0ad7d9c00bd4378a31f340876d8509f`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:57.848230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:57.918423 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1051/2109] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:25:57.921051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:57.931839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:57.934112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:58.010098 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7666cbde-ef79-4b54-9938-ef73a68e56c0 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:58.016489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85780b05-b9a1-4889-9794-6b8f1b2df39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:58.017105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85780b05-b9a1-4889-9794-6b8f1b2df39c service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:58.017386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85780b05-b9a1-4889-9794-6b8f1b2df39c service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:58.017659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85780b05-b9a1-4889-9794-6b8f1b2df39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:58.025600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85780b05-b9a1-4889-9794-6b8f1b2df39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:58.027290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85780b05-b9a1-4889-9794-6b8f1b2df39c service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:58.036193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1059/2110] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:25:58.294100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:58.333627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:58.734636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:58.928561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.026217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.027747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:59.095152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb0b0c-f700-428d-951d-4ec1037c64b8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.100107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.103692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.103692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.103692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] PATH_INFO: `/v3/users/4930d0daf6b04f20b825216711921340` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.103692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4930d0daf6b04f20b825216711921340)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.105496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.301614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4930d0daf6b04f20b825216711921340'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:59.407249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4930d0daf6b04f20b825216711921340'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:59.414811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4930d0daf6b04f20b825216711921340'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:59.426900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4930d0daf6b04f20b825216711921340'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:59.427566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4930d0daf6b04f20b825216711921340'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:25:59.433592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1052/2111] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:25:59 2022] DELETE /identity/v3/users/4930d0daf6b04f20b825216711921340 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:25:59.438616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.438911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.444193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.458955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:25:59.460304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:59.520817 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1060/2112] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:25:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:25:59.531811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:25:59.533231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:25:59.580714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:25:59.593119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d5a449-7dc6-47ee-b628-3402aaaef56c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:25:59.599856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:25:59.599856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:25:59.599856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:25:59.599856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:25:59.608537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:25:59.610069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:25:59.619651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1053/2113] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:25:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:00.173537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.175120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:00.191790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c9950-ec6e-4529-9143-d8f5b83e918b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.193189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.194777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:00.198361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.199331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.199615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.199889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] PATH_INFO: `/v3/users/1f6e7eb8ad464906aa5433a4e7a0bd1b` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.201745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f6e7eb8ad464906aa5433a4e7a0bd1b)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.203701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.214320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caca71d1-6d24-46cf-adfe-4197049cfd1e service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.220119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.221112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.221547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.222049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] PATH_INFO: `/v3/projects/939f14aa2cb4430e873c26c437bf24fc` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.223525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939f14aa2cb4430e873c26c437bf24fc)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.224984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:00.226888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.457070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f6e7eb8ad464906aa5433a4e7a0bd1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.457255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939f14aa2cb4430e873c26c437bf24fc', 'request_id': 'req-4b021f99-bce4-4c11-9647-44c3251e4c39'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.457936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f6e7eb8ad464906aa5433a4e7a0bd1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.470608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f6e7eb8ad464906aa5433a4e7a0bd1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.471384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f6e7eb8ad464906aa5433a4e7a0bd1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.554503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939f14aa2cb4430e873c26c437bf24fc', 'request_id': 'req-4b021f99-bce4-4c11-9647-44c3251e4c39'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.561337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939f14aa2cb4430e873c26c437bf24fc', 'request_id': 'req-4b021f99-bce4-4c11-9647-44c3251e4c39'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.571798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] The token cache is being invalidate because project 939f14aa2cb4430e873c26c437bf24fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:00.572088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.572733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.574295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1054/2114] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:00 2022] DELETE /identity/v3/projects/939f14aa2cb4430e873c26c437bf24fc => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:00.578653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.579943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:00.630719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-40a58a4d-74cc-4e81-b736-49643c1b3522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f6e7eb8ad464906aa5433a4e7a0bd1b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:00.644313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b021f99-bce4-4c11-9647-44c3251e4c39 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.645050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1061/2115] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:00 2022] DELETE /identity/v3/users/1f6e7eb8ad464906aa5433a4e7a0bd1b => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:00.649217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.649514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.649826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.670400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:00.671644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:00.705529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.712354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.712354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.712354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] PATH_INFO: `/v3/users/a85f7da3ae9649a389456fe3ab75812b` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.712354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85f7da3ae9649a389456fe3ab75812b)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.712354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.728094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:00.733566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1062/2116] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:00.743742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:00.748647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:00.802552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fffd411-c5c9-441b-af33-650e405cea7e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:00.806198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:00.806815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:00.807100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:00.807377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:00.816457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:00.817931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:00.827380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1063/2117] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:26:00.924406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85f7da3ae9649a389456fe3ab75812b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.031695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85f7da3ae9649a389456fe3ab75812b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.040267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85f7da3ae9649a389456fe3ab75812b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.057989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85f7da3ae9649a389456fe3ab75812b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.058703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85f7da3ae9649a389456fe3ab75812b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.067016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1055/2118] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:00 2022] DELETE /identity/v3/users/a85f7da3ae9649a389456fe3ab75812b => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:01.455689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.458436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:01.496148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c82663-b34c-41f1-9d9d-53810c00b9c2 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.567887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.568547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.568830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.569117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] PATH_INFO: `/v3/projects/9b15193636c14f5d821c7ae88830f113` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.570437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b15193636c14f5d821c7ae88830f113)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.573893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:01.598496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.601290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:01.617223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd828b94-c06a-49fe-b0b6-2e74c0f298f8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.622139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.623455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.623751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.624033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] PATH_INFO: `/v3/users/c0ad7d9c00bd4378a31f340876d8509f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.625229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ad7d9c00bd4378a31f340876d8509f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.627584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:01.740104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:01.763935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b15193636c14f5d821c7ae88830f113', 'request_id': 'req-24eb6665-8930-448e-865b-f76633e21a24'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.769614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b15193636c14f5d821c7ae88830f113', 'request_id': 'req-24eb6665-8930-448e-865b-f76633e21a24'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.775887 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b15193636c14f5d821c7ae88830f113', 'request_id': 'req-24eb6665-8930-448e-865b-f76633e21a24'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.870986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ad7d9c00bd4378a31f340876d8509f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.891874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] The token cache is being invalidate because project 9b15193636c14f5d821c7ae88830f113 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:01.892162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.892783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:01.894352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1064/2119] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:01 2022] DELETE /identity/v3/projects/9b15193636c14f5d821c7ae88830f113 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:01.895109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:01.896482 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:01.960411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24eb6665-8930-448e-865b-f76633e21a24 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:01.965060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:01.965982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:01.966263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:01.966575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] PATH_INFO: `/v3/projects/4e23ab2a68c5475dbed0ae3dc6a80e4d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:01.967732 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e23ab2a68c5475dbed0ae3dc6a80e4d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:01.969669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.000159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ad7d9c00bd4378a31f340876d8509f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.007928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ad7d9c00bd4378a31f340876d8509f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.019929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ad7d9c00bd4378a31f340876d8509f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.020616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5565e19c-6e6e-47a2-abf2-cc372970230e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ad7d9c00bd4378a31f340876d8509f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.026803 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1056/2120] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:01 2022] DELETE /identity/v3/users/c0ad7d9c00bd4378a31f340876d8509f => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:02.030967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6c88-7bf5-4104-a9c2-0b24b26c44e9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.031303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6c88-7bf5-4104-a9c2-0b24b26c44e9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.031585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d6c88-7bf5-4104-a9c2-0b24b26c44e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.051265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-719d6c88-7bf5-4104-a9c2-0b24b26c44e9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:02.053426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-719d6c88-7bf5-4104-a9c2-0b24b26c44e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.087946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e23ab2a68c5475dbed0ae3dc6a80e4d', 'request_id': 'req-43ea18cd-d19d-4794-89ca-1fb66a885d6f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.094279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e23ab2a68c5475dbed0ae3dc6a80e4d', 'request_id': 'req-43ea18cd-d19d-4794-89ca-1fb66a885d6f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.100460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e23ab2a68c5475dbed0ae3dc6a80e4d', 'request_id': 'req-43ea18cd-d19d-4794-89ca-1fb66a885d6f'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.113523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1057/2121] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:02.121191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529548e3-176a-4741-845b-60f155849b3d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.121191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529548e3-176a-4741-845b-60f155849b3d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.121191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529548e3-176a-4741-845b-60f155849b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.134386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-529548e3-176a-4741-845b-60f155849b3d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:02.135588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-529548e3-176a-4741-845b-60f155849b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.164104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.190332 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] The token cache is being invalidate because project 4e23ab2a68c5475dbed0ae3dc6a80e4d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:02.190755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.191605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-43ea18cd-d19d-4794-89ca-1fb66a885d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:02.193494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1065/2122] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:01 2022] DELETE /identity/v3/projects/4e23ab2a68c5475dbed0ae3dc6a80e4d => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:02.194426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1058/2123] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:02.198258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f978-7ee7-4321-ab61-c70fdb98d592 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.198258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f978-7ee7-4321-ab61-c70fdb98d592 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.198442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.198529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb9f978-7ee7-4321-ab61-c70fdb98d592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.198679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.199090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.221820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ceb9f978-7ee7-4321-ab61-c70fdb98d592 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:02.222022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:02.223101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ceb9f978-7ee7-4321-ab61-c70fdb98d592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.223217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.238139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1059/2124] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:02.238139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.238446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1066/2125] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:02.238446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f978-7ee7-4321-ab61-c70fdb98d592 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.239645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.246218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb9f978-7ee7-4321-ab61-c70fdb98d592 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.251811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56566ed-c73c-44cf-8b28-ee9cf0bdfcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.251975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56566ed-c73c-44cf-8b28-ee9cf0bdfcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.252317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56566ed-c73c-44cf-8b28-ee9cf0bdfcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.252426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56566ed-c73c-44cf-8b28-ee9cf0bdfcd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.253190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56566ed-c73c-44cf-8b28-ee9cf0bdfcd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:02.253407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56566ed-c73c-44cf-8b28-ee9cf0bdfcd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.255044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56566ed-c73c-44cf-8b28-ee9cf0bdfcd7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.267209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1067/2126] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:02.271657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44732395-f600-411c-8239-a29161626cdc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.271657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44732395-f600-411c-8239-a29161626cdc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.271657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44732395-f600-411c-8239-a29161626cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.289752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-44732395-f600-411c-8239-a29161626cdc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:02.291143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-44732395-f600-411c-8239-a29161626cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.300432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1068/2127] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:02.301711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44732395-f600-411c-8239-a29161626cdc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.306219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ee6ce4-a526-42b1-967e-98c706e1047e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.311204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.312004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.312284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.312550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.312782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44732395-f600-411c-8239-a29161626cdc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.314644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:02.318761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.319458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.319981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.320354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.321097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.323190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.331136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.332577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.347739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1060/2128] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:02.348590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.358567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071621c0-b626-4f34-ae8a-0d20c67cf268 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.363963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.364591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.364873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.365150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.366246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:02.368270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.368696 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.384944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1061/2129] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:02.394633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.405395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b6f44-ff8c-4a69-a6ad-84dc49931214 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.410252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.421799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1069/2130] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:02.422053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.422053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.422053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.422053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.422053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.478642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.517475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1062/2131] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:02.521572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.544525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b714a5d-cec7-4f05-aa4f-f980e1ddf2ce admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.584327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80721169-5bce-4346-91c8-d45bc8a55a89 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.589045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.589650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.589964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.590245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.591165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.593094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.600609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.601226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.601499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.601792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.602455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.604342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.648198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:02.740068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1063/2132] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/users => generated 287 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:02.743802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.756350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ffd1a-91d9-472c-886e-ba2137d69d39 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.761875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.762612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.762964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.763826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.764600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.766329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.777572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1064/2133] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:02.782666 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.795659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27f88ce-efa5-45d1-877a-1b24bc893fb4 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.800930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1070/2134] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:02 2022] POST /identity/v3/users => generated 290 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:02.802273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.813156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.813544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.814247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.814912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.816021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.820693 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee7b06f-c82a-4b97-ade0-94c2eebe709a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.822398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.834597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.835403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.836963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.837388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.838246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.840756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.843649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1065/2135] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:02.847869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.857139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1071/2136] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:02.858124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.860683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89846970-0dac-4755-87a0-27588a026fd9 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.867157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.867839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.868214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.868623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] PATH_INFO: `/v3/projects/922ea374cf6a4c0e9f78584c626794f2/users/ba77e6c7cf624b1bb18acef8cebc4de3/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.869203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798c59b-4bb8-47cb-991d-133b50303655 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.874525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.875190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.875474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.875748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.876527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.878283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.885324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=922ea374cf6a4c0e9f78584c626794f2, user_id=ba77e6c7cf624b1bb18acef8cebc4de3, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.888020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.890240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1072/2137] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:02.894292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.906920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca20c36-8c1f-491a-b69a-af754c039217 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:02.912052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4118dd3b-e44e-48b4-b31e-321f5835848b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:02.913102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dd3b-e44e-48b4-b31e-321f5835848b admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:02.913401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dd3b-e44e-48b4-b31e-321f5835848b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:02.913661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4118dd3b-e44e-48b4-b31e-321f5835848b admin admin] PATH_INFO: `/v3/projects/09e1f32b9502471fa13e71685c01a16e/users/0104b0fa57ac4ea280ffd3fc540e6358/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:02.936498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118dd3b-e44e-48b4-b31e-321f5835848b admin admin] RBAC: Authorizing `identity:create_grant(project_id=09e1f32b9502471fa13e71685c01a16e, user_id=0104b0fa57ac4ea280ffd3fc540e6358, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:02.939510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4118dd3b-e44e-48b4-b31e-321f5835848b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:02.994984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1066/2138] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:02 2022] PUT /identity/v3/projects/922ea374cf6a4c0e9f78584c626794f2/users/ba77e6c7cf624b1bb18acef8cebc4de3/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:02.994984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:02.994984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:03.014878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:03.027502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1073/2139] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:02 2022] PUT /identity/v3/projects/09e1f32b9502471fa13e71685c01a16e/users/0104b0fa57ac4ea280ffd3fc540e6358/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:03.027502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd09f-7209-4a2d-9e2b-cbfbbf3a3e4b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.027502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd09f-7209-4a2d-9e2b-cbfbbf3a3e4b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.027502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94bd09f-7209-4a2d-9e2b-cbfbbf3a3e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.059193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a94bd09f-7209-4a2d-9e2b-cbfbbf3a3e4b None None] MFA Rules not processed for user `ba77e6c7cf624b1bb18acef8cebc4de3`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:03.060436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a94bd09f-7209-4a2d-9e2b-cbfbbf3a3e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:03.069455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c45a598-214b-4d56-be85-2cd53c1f7f74 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.136233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.136916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.137054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1074/2140] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:03.137193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.137463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] PATH_INFO: `/v3/projects/cdbe2f82714943548e6396c1f1e66a04` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.138718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdbe2f82714943548e6396c1f1e66a04)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.139347 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4020-a9cb-45ee-b8c1-e54843fcc071 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.139911 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4020-a9cb-45ee-b8c1-e54843fcc071 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.140616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.141085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd4020-a9cb-45ee-b8c1-e54843fcc071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.167293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-bcfd4020-a9cb-45ee-b8c1-e54843fcc071 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:03.168524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-bcfd4020-a9cb-45ee-b8c1-e54843fcc071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:03.177283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1075/2141] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:03.178114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4020-a9cb-45ee-b8c1-e54843fcc071 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.189926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd4020-a9cb-45ee-b8c1-e54843fcc071 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.195299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.196249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.196716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.197046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.197720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.199910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.291785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdbe2f82714943548e6396c1f1e66a04', 'request_id': 'req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:03.313483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1076/2142] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:03.314373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.316378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:03.367489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdbe2f82714943548e6396c1f1e66a04', 'request_id': 'req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:03.374470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdbe2f82714943548e6396c1f1e66a04', 'request_id': 'req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:03.379403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc0be82-374f-4bc5-89ac-6201d05b2a23 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.384480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd5f204-e4a0-473d-a021-c0e325d8d69c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.385136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f204-e4a0-473d-a021-c0e325d8d69c service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.385434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f204-e4a0-473d-a021-c0e325d8d69c service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.385707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5f204-e4a0-473d-a021-c0e325d8d69c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.386828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] The token cache is being invalidate because project cdbe2f82714943548e6396c1f1e66a04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:03.399246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:03.400067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:03.406181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1067/2143] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:02 2022] DELETE /identity/v3/projects/cdbe2f82714943548e6396c1f1e66a04 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:03.406929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.408514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:03.473441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5f204-e4a0-473d-a021-c0e325d8d69c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.475270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd5f204-e4a0-473d-a021-c0e325d8d69c service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.482479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a650ccd-d6d4-46ad-903b-2deb7c6577cb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.487753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.488378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.488758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.488942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1077/2144] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:03.489380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.489694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.490965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015085-3aef-45f3-bbad-fd7d8366190c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.491759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.492061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015085-3aef-45f3-bbad-fd7d8366190c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.492487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae015085-3aef-45f3-bbad-fd7d8366190c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.513610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ae015085-3aef-45f3-bbad-fd7d8366190c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:03.514794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ae015085-3aef-45f3-bbad-fd7d8366190c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:03.523134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1078/2145] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:03.532198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d90d3-5b19-49ef-9e68-c881739899eb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.532492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d90d3-5b19-49ef-9e68-c881739899eb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.532779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d90d3-5b19-49ef-9e68-c881739899eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.554239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3f4d90d3-5b19-49ef-9e68-c881739899eb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:03.555468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3f4d90d3-5b19-49ef-9e68-c881739899eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:03.567636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1079/2146] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:03.571855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d90d3-5b19-49ef-9e68-c881739899eb None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.585725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d90d3-5b19-49ef-9e68-c881739899eb None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.591551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.592198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.592684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.592684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.594232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:03.594552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.596167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.601422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1068/2147] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:03.608999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.612647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1080/2148] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:03.616907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.623100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65887e0-d406-4a49-b30f-0a0c3681da3b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.628106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.628735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.629024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.629306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.630044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.633511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581383a8-eab2-4d28-9140-9e943958e987 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.633629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.636161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.636897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.637287 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.637629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.638956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.640947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.643111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1069/2149] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:03.647302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.658383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410b42e-d05f-4a42-9c0c-d39a01e0ce9a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.663129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:03.666143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.667185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.667547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.667973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] PATH_INFO: `/v3/projects/4d8e4ba138be4576a59f55da74d67a00/users/b57000db0f8143f6bf17f91249717ec2/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.689592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8e4ba138be4576a59f55da74d67a00, user_id=b57000db0f8143f6bf17f91249717ec2, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.692838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.789045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1070/2150] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:03 2022] PUT /identity/v3/projects/4d8e4ba138be4576a59f55da74d67a00/users/b57000db0f8143f6bf17f91249717ec2/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:03.793643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.807250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1081/2151] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/projects => generated 365 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:03.808335 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.921962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8590d8-028a-4189-a6dc-fa3eb69abfe0 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.923728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0f238-2ae0-4c10-9f26-c51fb16e47e9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.929022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.929939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.930343 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.931540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.933221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.939887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.945265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.947156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.948170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.952081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1071/2152] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:03.952235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.952235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.953997 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:03.955367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.967580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:03.972233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9438fb-3bfe-4b01-a23d-d9887731ba32 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:03.979710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ed077-9462-4f99-96df-0d865a43fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:03.979710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ed077-9462-4f99-96df-0d865a43fbf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:03.979710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ed077-9462-4f99-96df-0d865a43fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:03.979710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ed077-9462-4f99-96df-0d865a43fbf8 admin admin] PATH_INFO: `/v3/projects/4d8e4ba138be4576a59f55da74d67a00/users/b57000db0f8143f6bf17f91249717ec2/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:03.981700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ed077-9462-4f99-96df-0d865a43fbf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d8e4ba138be4576a59f55da74d67a00, user_id=b57000db0f8143f6bf17f91249717ec2, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:03.985333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ed077-9462-4f99-96df-0d865a43fbf8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:03.999965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1072/2153] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:03 2022] PUT /identity/v3/projects/4d8e4ba138be4576a59f55da74d67a00/users/b57000db0f8143f6bf17f91249717ec2/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:04.010039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c79a5-7cbd-464f-a737-8f6f59ba3994 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.014168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c79a5-7cbd-464f-a737-8f6f59ba3994 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.014168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8c79a5-7cbd-464f-a737-8f6f59ba3994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.046027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-5e8c79a5-7cbd-464f-a737-8f6f59ba3994 None None] MFA Rules not processed for user `b57000db0f8143f6bf17f91249717ec2`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:04.047244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5e8c79a5-7cbd-464f-a737-8f6f59ba3994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:04.073099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1082/2154] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:03 2022] POST /identity/v3/users => generated 283 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:04.076966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.089313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0c9f5c-8d21-4946-a284-f50e77613e83 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.147643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1073/2155] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:04.172235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.172860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.173143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.173418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.174159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:04.175752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:04.187341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1083/2156] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:04.192909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c79a5-7cbd-464f-a737-8f6f59ba3994 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.203869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8c79a5-7cbd-464f-a737-8f6f59ba3994 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.208743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.209508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.209945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.210320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.211086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:04.213360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:04.224477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1074/2157] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:04.230223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.241383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54406b8-9885-4c30-ae66-d0336928f19a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.246689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c073e5-61c8-4c91-962c-38332ebb1109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.247503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c073e5-61c8-4c91-962c-38332ebb1109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.247781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c073e5-61c8-4c91-962c-38332ebb1109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.248207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c073e5-61c8-4c91-962c-38332ebb1109 admin admin] PATH_INFO: `/v3/projects/8740f89903a84a208df51223d13c46f5/users/e6bbdf3c659c4b36a17875f1a5a3c069/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.268603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c073e5-61c8-4c91-962c-38332ebb1109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8740f89903a84a208df51223d13c46f5, user_id=e6bbdf3c659c4b36a17875f1a5a3c069, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:04.271478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c073e5-61c8-4c91-962c-38332ebb1109 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:04.345294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.347071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:04.396612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1084/2158] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:04 2022] PUT /identity/v3/projects/8740f89903a84a208df51223d13c46f5/users/e6bbdf3c659c4b36a17875f1a5a3c069/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:04.403948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4308-0431-409c-9e4e-a30e451ef611 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.406962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef9b10-62cf-42e4-93b5-a0b39ab297a5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.407289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef9b10-62cf-42e4-93b5-a0b39ab297a5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.407537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ef9b10-62cf-42e4-93b5-a0b39ab297a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.436496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-83ef9b10-62cf-42e4-93b5-a0b39ab297a5 None None] MFA Rules not processed for user `e6bbdf3c659c4b36a17875f1a5a3c069`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:04.437787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-83ef9b10-62cf-42e4-93b5-a0b39ab297a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:04.453618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.454285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.454573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.454857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.457001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:04.516095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1085/2159] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:04.516998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef9b10-62cf-42e4-93b5-a0b39ab297a5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.540983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:04.542522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:04.553020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1075/2160] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:04.597807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ef9b10-62cf-42e4-93b5-a0b39ab297a5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.603383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.604130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.604416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.604692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.605370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:04.607628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:04.737660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1086/2161] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:04 2022] POST /identity/v3/projects => generated 365 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:04.741861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.754846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d364dee5-39a6-40b2-8e23-625b0a88514f service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.838420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.839050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.839327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.839601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.840292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:04.843289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:04.962708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1076/2162] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:04 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:04.967391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:04.978501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc16fdd-ddc2-4083-8ca8-15f86e89778c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:04.983939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708a0108-72e5-435d-9ff2-4bccaa7cc8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:04.984560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a0108-72e5-435d-9ff2-4bccaa7cc8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:04.984842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a0108-72e5-435d-9ff2-4bccaa7cc8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:04.985112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708a0108-72e5-435d-9ff2-4bccaa7cc8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:04.985904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a0108-72e5-435d-9ff2-4bccaa7cc8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:04.987515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708a0108-72e5-435d-9ff2-4bccaa7cc8c1 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.001241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1087/2163] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:05.002688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.013929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401a546-2137-4fa4-b4ab-3792afdbe617 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.018805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.019479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.019789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.020061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] PATH_INFO: `/v3/projects/eb9365b2fc7b46e9833fe54b37d45266/users/e0c2a6e031794ef5b5c3ef5fa053038f/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.041476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9365b2fc7b46e9833fe54b37d45266, user_id=e0c2a6e031794ef5b5c3ef5fa053038f, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.041476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.113252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303dd65-23f8-4202-91dc-958ee1f19eb5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.113647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303dd65-23f8-4202-91dc-958ee1f19eb5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.114018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8303dd65-23f8-4202-91dc-958ee1f19eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.134703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8303dd65-23f8-4202-91dc-958ee1f19eb5 None None] MFA Rules not processed for user `7eaf1befe60e4038a4247d1c0cce2ffb`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:05.135986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8303dd65-23f8-4202-91dc-958ee1f19eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:05.195230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1077/2164] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:05 2022] PUT /identity/v3/projects/eb9365b2fc7b46e9833fe54b37d45266/users/e0c2a6e031794ef5b5c3ef5fa053038f/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:05.196691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.209708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1088/2165] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:05.296493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113efc6-73f7-4b2d-bd01-0e8408203ed1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.311787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63cd70f-1704-4832-9b9f-0f825ad2ee98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.312789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cd70f-1704-4832-9b9f-0f825ad2ee98 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.313304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cd70f-1704-4832-9b9f-0f825ad2ee98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.313681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63cd70f-1704-4832-9b9f-0f825ad2ee98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.314675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cd70f-1704-4832-9b9f-0f825ad2ee98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.316399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63cd70f-1704-4832-9b9f-0f825ad2ee98 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.336000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1078/2166] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:05.336846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303dd65-23f8-4202-91dc-958ee1f19eb5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.354946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8303dd65-23f8-4202-91dc-958ee1f19eb5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.360961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.361906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.362194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.362470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] PATH_INFO: `/v3/projects/eb9365b2fc7b46e9833fe54b37d45266/users/e0c2a6e031794ef5b5c3ef5fa053038f/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.364663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9365b2fc7b46e9833fe54b37d45266, user_id=e0c2a6e031794ef5b5c3ef5fa053038f, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.368070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.384437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1089/2167] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:05 2022] PUT /identity/v3/projects/eb9365b2fc7b46e9833fe54b37d45266/users/e0c2a6e031794ef5b5c3ef5fa053038f/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:05.394924 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.396113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.396391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.430391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] MFA Rules not processed for user `e0c2a6e031794ef5b5c3ef5fa053038f`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:05.431713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:05.545822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1079/2168] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:05.553801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.616169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd754fd6-fb13-4d8a-b96c-f90ae0c5aca7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.620231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.620854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.621131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.621401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.633574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.635116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.646271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1090/2169] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:05.787383 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.789903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:05.891947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a177d2b-c162-47b2-9a63-accc2013cfb6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.897640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.898442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.898823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.899198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] PATH_INFO: `/v3/users/dc378b684bbe4ed9a559b1f118683e69` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:05.900783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc378b684bbe4ed9a559b1f118683e69)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:05.907970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:05.968788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:05.979831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374869f-ddd0-4a2a-a313-34f495a41dd9 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:05.990305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb858de-09f4-4753-accf-445a6e742790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:05.990305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb858de-09f4-4753-accf-445a6e742790 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:05.990305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb858de-09f4-4753-accf-445a6e742790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:05.990305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb858de-09f4-4753-accf-445a6e742790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.014772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.083052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb858de-09f4-4753-accf-445a6e742790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.084549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb858de-09f4-4753-accf-445a6e742790 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.117712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1091/2170] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:26:06.149313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc378b684bbe4ed9a559b1f118683e69'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:06.252116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=1,keystone:SELECT=94,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:06.254073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc378b684bbe4ed9a559b1f118683e69'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:06.264170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc378b684bbe4ed9a559b1f118683e69'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:06.285506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc378b684bbe4ed9a559b1f118683e69'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:06.286367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc378b684bbe4ed9a559b1f118683e69'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:06.294308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1080/2171] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:05 2022] DELETE /identity/v3/users/dc378b684bbe4ed9a559b1f118683e69 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:06.298551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.298955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.299297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.328890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:06.330310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:06.477902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1092/2172] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:06.517004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:06.518669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:06.646773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a023d623-b958-4a46-8338-31f937f6d4f7 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:06.656108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfbcdc-de51-4b10-b6b7-573a408de163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:06.658174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfbcdc-de51-4b10-b6b7-573a408de163 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:06.659311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfbcdc-de51-4b10-b6b7-573a408de163 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:06.659744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfbcdc-de51-4b10-b6b7-573a408de163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:06.681296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfbcdc-de51-4b10-b6b7-573a408de163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:06.683258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfbcdc-de51-4b10-b6b7-573a408de163 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:06.695873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1081/2173] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:07.544856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:07.629820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:07.631580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:07.667842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2ebd4a-0d6a-4017-9bac-4c3d1178fe7e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:07.679938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:07.680610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:07.680890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:07.681168 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] PATH_INFO: `/v3/projects/a8f3605b61554825a567ad2786505038` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:07.682625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8f3605b61554825a567ad2786505038)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:07.684889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:07.862918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8f3605b61554825a567ad2786505038', 'request_id': 'req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:07.873515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8f3605b61554825a567ad2786505038', 'request_id': 'req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:07.880699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8f3605b61554825a567ad2786505038', 'request_id': 'req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:07.950090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] The token cache is being invalidate because project a8f3605b61554825a567ad2786505038 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:07.950958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:07.952137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:07.954176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1093/2174] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:07 2022] DELETE /identity/v3/projects/a8f3605b61554825a567ad2786505038 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:07.959019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d15eb-5329-4d82-a6c7-82fd86e8831b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:07.959557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d15eb-5329-4d82-a6c7-82fd86e8831b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:07.959557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d15eb-5329-4d82-a6c7-82fd86e8831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.004238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-200d15eb-5329-4d82-a6c7-82fd86e8831b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:08.017877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-200d15eb-5329-4d82-a6c7-82fd86e8831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.018246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.018797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.129088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b7c9b6-867b-4a11-8987-8bc3c804ce5b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.134875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.135792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.135907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.136424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] PATH_INFO: `/v3/users/ba77e6c7cf624b1bb18acef8cebc4de3` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.139267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1082/2175] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:08.146624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba77e6c7cf624b1bb18acef8cebc4de3)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.146624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.151978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b3f4-bdd2-4a89-99e9-33837a59b3c9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.151978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b3f4-bdd2-4a89-99e9-33837a59b3c9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.151978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0b3f4-bdd2-4a89-99e9-33837a59b3c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.173802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-41e0b3f4-bdd2-4a89-99e9-33837a59b3c9 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:08.175835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-41e0b3f4-bdd2-4a89-99e9-33837a59b3c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.192049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1083/2176] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:08.193037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b3f4-bdd2-4a89-99e9-33837a59b3c9 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.203773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0b3f4-bdd2-4a89-99e9-33837a59b3c9 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.209867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.210492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.210768 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.211039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.215680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:08.215680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.215680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.226978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1084/2177] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:26:08.231363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.243038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf753ae-3d92-466c-86d4-6a44321a64dc admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.251512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.252337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.252701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.253048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.253805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.255771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.363036 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba77e6c7cf624b1bb18acef8cebc4de3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:08.364426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba77e6c7cf624b1bb18acef8cebc4de3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:08.379161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba77e6c7cf624b1bb18acef8cebc4de3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:08.382198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba77e6c7cf624b1bb18acef8cebc4de3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:08.398521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:08.407558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1085/2178] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:08 2022] POST /identity/v3/projects => generated 383 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:08.411363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.413309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.470854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d093ff6b-6856-4633-8056-a736dcadb797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba77e6c7cf624b1bb18acef8cebc4de3'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:08.494090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1094/2179] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:08 2022] DELETE /identity/v3/users/ba77e6c7cf624b1bb18acef8cebc4de3 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:08.496163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.496454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.496726 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.555157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71e8e5-93ef-4da3-ad14-5b7a5f6b3817 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.563008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:08.567495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.709744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.710135 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.710415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.710694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.711356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.713558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.719972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1095/2180] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:08.745023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.746551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:08.832146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1086/2181] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:08 2022] POST /identity/v3/users => generated 292 bytes in 421 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:08.835683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.848021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55f8c6-ed50-4fa4-867d-3dbc623b0757 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.853481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3ac4e-623c-46cc-8bad-76a257146abf None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.861538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.862715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.863313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.863840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.873274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.873951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.874237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.874513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.875363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.876828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.893074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1087/2182] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:08.894365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:08.894556 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.896224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.898044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.905414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5680503-17ea-4894-a788-d0c4abc9ba51 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.909990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1096/2183] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:08.911643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd743f0f-13de-470b-9d2f-1596daaddcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.912299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd743f0f-13de-470b-9d2f-1596daaddcaa admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.914049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd743f0f-13de-470b-9d2f-1596daaddcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.914049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd743f0f-13de-470b-9d2f-1596daaddcaa admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.914049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd743f0f-13de-470b-9d2f-1596daaddcaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.915743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd743f0f-13de-470b-9d2f-1596daaddcaa admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:08.928507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1088/2184] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:08.932767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:08.944587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca581c-c3d3-4135-aa40-9621e72f7df2 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:08.953043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:08.954066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:08.954598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:08.955260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] PATH_INFO: `/v3/projects/375c2a9259ef42fda2c12080e4b0bf94/users/7701af5a552047d59186418f90bf81e6/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:08.979423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=375c2a9259ef42fda2c12080e4b0bf94, user_id=7701af5a552047d59186418f90bf81e6, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:08.982216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.057006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1097/2185] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:08 2022] PUT /identity/v3/projects/375c2a9259ef42fda2c12080e4b0bf94/users/7701af5a552047d59186418f90bf81e6/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:09.065983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.066466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.066466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.080622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:09.122895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] MFA Rules not processed for user `7701af5a552047d59186418f90bf81e6`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:09.124163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:09.226713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1089/2186] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:09.239898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.242147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:09.339735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cef0b-e4aa-4104-a3b9-12a3e9f5c05c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.344792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.345492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.345868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.346601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.356067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.359155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.371761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1098/2187] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:09 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:09.461452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.463620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:09.566088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e75f4a7-7586-4001-b555-d73ed44a447f None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:09.571259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:09.571912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:09.572201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:09.572472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] PATH_INFO: `/v3/projects/922ea374cf6a4c0e9f78584c626794f2` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:09.573657 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=922ea374cf6a4c0e9f78584c626794f2)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:09.576560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:09.742082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '922ea374cf6a4c0e9f78584c626794f2', 'request_id': 'req-449ec4d2-440e-4369-ab97-1a558f76ce18'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:09.852305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '922ea374cf6a4c0e9f78584c626794f2', 'request_id': 'req-449ec4d2-440e-4369-ab97-1a558f76ce18'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:09.862952 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '922ea374cf6a4c0e9f78584c626794f2', 'request_id': 'req-449ec4d2-440e-4369-ab97-1a558f76ce18'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:09.879428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] The token cache is being invalidate because project 922ea374cf6a4c0e9f78584c626794f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:09.883328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:09.883328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:09.883328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1090/2188] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:09 2022] DELETE /identity/v3/projects/922ea374cf6a4c0e9f78584c626794f2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:09.886893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:09.913850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae9ef4-9eeb-4199-858c-811923f80bec service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:10.023065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:10.024169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:10.024514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:10.024852 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] PATH_INFO: `/v3/users/b57000db0f8143f6bf17f91249717ec2` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:10.026175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b57000db0f8143f6bf17f91249717ec2)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:10.028266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:10.252325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b57000db0f8143f6bf17f91249717ec2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:10.253729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b57000db0f8143f6bf17f91249717ec2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:10.276542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b57000db0f8143f6bf17f91249717ec2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:10.287679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b57000db0f8143f6bf17f91249717ec2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:10.378574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ffa7460b-5af2-4e23-9346-d06ceea2038e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b57000db0f8143f6bf17f91249717ec2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:10.411366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1099/2189] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:09 2022] DELETE /identity/v3/users/b57000db0f8143f6bf17f91249717ec2 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:10.494700 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:10.848022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:11.135855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.137000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:11.162309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449ec4d2-440e-4369-ab97-1a558f76ce18 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.247654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.248630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.249073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.249480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] PATH_INFO: `/v3/projects/4d8e4ba138be4576a59f55da74d67a00` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.251387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d8e4ba138be4576a59f55da74d67a00)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.254099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.397350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d8e4ba138be4576a59f55da74d67a00', 'request_id': 'req-dfb64ea0-d538-4874-b298-c229cafb37d0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:11.446630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.447485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.453266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.481230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d8e4ba138be4576a59f55da74d67a00', 'request_id': 'req-dfb64ea0-d538-4874-b298-c229cafb37d0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:11.486295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] MFA Rules not processed for user `0104b0fa57ac4ea280ffd3fc540e6358`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:11.487814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:11.495763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d8e4ba138be4576a59f55da74d67a00', 'request_id': 'req-dfb64ea0-d538-4874-b298-c229cafb37d0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:11.517842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] The token cache is being invalidate because project 4d8e4ba138be4576a59f55da74d67a00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:11.518146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:11.522486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dfb64ea0-d538-4874-b298-c229cafb37d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:11.524947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1091/2190] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:11 2022] DELETE /identity/v3/projects/4d8e4ba138be4576a59f55da74d67a00 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:11.530525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a540-a901-44cf-976d-c9adb71778ff None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.530813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a540-a901-44cf-976d-c9adb71778ff None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.532730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f7a540-a901-44cf-976d-c9adb71778ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.572902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d9f7a540-a901-44cf-976d-c9adb71778ff None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:11.574079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d9f7a540-a901-44cf-976d-c9adb71778ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:11.607229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1100/2191] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:11.611960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.613713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:11.664360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1092/2192] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:11.665984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e496-4c0b-44cf-9a93-a713b414a73b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.666411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e496-4c0b-44cf-9a93-a713b414a73b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.667953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae35e496-4c0b-44cf-9a93-a713b414a73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.690834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd5776-3cb2-42ce-bb50-1c9f442433ed None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.695970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ae35e496-4c0b-44cf-9a93-a713b414a73b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:11.696924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.697195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ae35e496-4c0b-44cf-9a93-a713b414a73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:11.697755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.698176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.699237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.699590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.703122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.713518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1093/2193] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:11.718530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35e496-4c0b-44cf-9a93-a713b414a73b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.729317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae35e496-4c0b-44cf-9a93-a713b414a73b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.737501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.738561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.739340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.739916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.741076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:11.741687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.746757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.760014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1094/2194] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:11.765095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.779829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03023737-3897-4f5c-bd5d-d5ff5870bf96 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.784597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:11.791444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1101/2195] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:11.794742 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.873085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e8791-6dbc-4e00-91ae-d6ddbfde9075 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:11.877893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.878544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.879002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.879138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:11.879573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.879843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:11.879957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.880909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:11.881191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:11.881897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:11.882021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.883859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:11.991918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1102/2196] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/users => generated 295 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:11.992312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1095/2197] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/projects => generated 373 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:11.996323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:11.998652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.022048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9a66a-4277-40d1-918b-2b6ebecd4cb6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.118339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac9528b-3bcf-4e1a-9529-631ed71b52ae admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.126113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.127225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.127524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.127791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.128509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.132033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.176072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.176846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.177205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.177553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.178495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.180462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.193946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1103/2198] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:12.194604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1096/2199] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:11 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:12.198853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.201124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.221530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a060de-85b3-4ae9-b675-ff6b3e06dac6 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.224799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f33a12-3a80-4d67-bc8a-a888c5ea26a5 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.227917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.228328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.228872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.229259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.229462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.229728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] PATH_INFO: `/v3/projects/34175abb7eb540bdb12484eb85f562dd/users/2b323955c030440faeed55bfe618db8b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.230056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.230527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.231609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.233836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.248798 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1097/2200] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:12.250146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34175abb7eb540bdb12484eb85f562dd, user_id=2b323955c030440faeed55bfe618db8b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.252651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.253441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.266446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a62e23-caaa-42ec-ae2b-f40d36928dac admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.272478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.273107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.273390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.273874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.274761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.276368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.286576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1098/2201] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:12.290850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.300788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ca64e-cc48-47b6-8ca1-b674ac2c47f0 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.306436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50277312-dde6-4415-98fa-5f2b400f1b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.307126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50277312-dde6-4415-98fa-5f2b400f1b76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.307414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50277312-dde6-4415-98fa-5f2b400f1b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.314386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50277312-dde6-4415-98fa-5f2b400f1b76 admin admin] PATH_INFO: `/v3/projects/da062c3ac660484bbc7e0370e747e625/users/c3e703605a14484c87ab827d746eea47/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.314690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1104/2202] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:12 2022] PUT /identity/v3/projects/34175abb7eb540bdb12484eb85f562dd/users/2b323955c030440faeed55bfe618db8b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:12.315708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.325896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50277312-dde6-4415-98fa-5f2b400f1b76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da062c3ac660484bbc7e0370e747e625, user_id=c3e703605a14484c87ab827d746eea47, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.328678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50277312-dde6-4415-98fa-5f2b400f1b76 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.424973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33b0e81-8e0e-48d4-9d1f-0a15923d8553 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.442782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.445179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.445321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.445656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.446544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.449344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.460405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1105/2203] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:12.464499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.476531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155ebdfb-ffde-4a8a-99f1-95a2b79423a8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.480702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1099/2204] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:12 2022] PUT /identity/v3/projects/da062c3ac660484bbc7e0370e747e625/users/c3e703605a14484c87ab827d746eea47/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:12.533155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:12.543584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.545241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.545585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.545967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] PATH_INFO: `/v3/projects/34175abb7eb540bdb12484eb85f562dd/users/2b323955c030440faeed55bfe618db8b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.548366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] RBAC: Authorizing `identity:create_grant(project_id=34175abb7eb540bdb12484eb85f562dd, user_id=2b323955c030440faeed55bfe618db8b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.551816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.555731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.556387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.556733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.565952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1106/2205] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:12 2022] PUT /identity/v3/projects/34175abb7eb540bdb12484eb85f562dd/users/2b323955c030440faeed55bfe618db8b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:12.587702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] MFA Rules not processed for user `c3e703605a14484c87ab827d746eea47`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:12.588932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:12.654764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1100/2206] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:12.665474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:12.671124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:12.742190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28dbcd8-59e0-4b65-a54f-9a0ae486803a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:12.745992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0a455e-0be2-469c-9f40-14076ea344bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:12.746620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a455e-0be2-469c-9f40-14076ea344bd service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:12.746936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a455e-0be2-469c-9f40-14076ea344bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:12.747214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0a455e-0be2-469c-9f40-14076ea344bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:12.755830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a455e-0be2-469c-9f40-14076ea344bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:12.757265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0a455e-0be2-469c-9f40-14076ea344bd service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:12.766634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1107/2207] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:13.304739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:13.607846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:14.984257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:14.986007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:15.071873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba03a6f9-82df-4cce-8103-93bef7717800 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.078438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.079850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.080297 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.080725 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] PATH_INFO: `/v3/users/7701af5a552047d59186418f90bf81e6` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.082530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7701af5a552047d59186418f90bf81e6)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.086021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.400141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7701af5a552047d59186418f90bf81e6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:15.518462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7701af5a552047d59186418f90bf81e6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:15.534317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7701af5a552047d59186418f90bf81e6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:15.567875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7701af5a552047d59186418f90bf81e6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:15.568683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7701af5a552047d59186418f90bf81e6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:15.581133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1101/2208] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:14 2022] DELETE /identity/v3/users/7701af5a552047d59186418f90bf81e6 => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:15.584393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.584868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.584944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.607563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:15.608801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:15.676638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1108/2209] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:15.687111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:15.688262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:15.688693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:15.748241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3123f-7fad-4d42-bcc6-9652fa84566f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:15.753495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688f69b-b239-4aa3-bf5f-305d357eca5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:15.754108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f69b-b239-4aa3-bf5f-305d357eca5c service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:15.754384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f69b-b239-4aa3-bf5f-305d357eca5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:15.754660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688f69b-b239-4aa3-bf5f-305d357eca5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:15.780276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f69b-b239-4aa3-bf5f-305d357eca5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:15.781968 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688f69b-b239-4aa3-bf5f-305d357eca5c service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:15.807892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1102/2210] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:16.105078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:16.679496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:16.681103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:16.694807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153eac8d-634e-4642-a168-4c73a56009cd None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:16.700256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:16.701165 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:16.701663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:16.702120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] PATH_INFO: `/v3/projects/375c2a9259ef42fda2c12080e4b0bf94` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:16.708152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=375c2a9259ef42fda2c12080e4b0bf94)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:16.711119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:16.857504 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '375c2a9259ef42fda2c12080e4b0bf94', 'request_id': 'req-4dfd2831-f73e-4119-b712-6152afc001e0'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:16.866470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '375c2a9259ef42fda2c12080e4b0bf94', 'request_id': 'req-4dfd2831-f73e-4119-b712-6152afc001e0'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:16.875530 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '375c2a9259ef42fda2c12080e4b0bf94', 'request_id': 'req-4dfd2831-f73e-4119-b712-6152afc001e0'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:16.956729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] The token cache is being invalidate because project 375c2a9259ef42fda2c12080e4b0bf94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:16.957372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:16.959278 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4dfd2831-f73e-4119-b712-6152afc001e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:16.962975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1109/2211] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:16 2022] DELETE /identity/v3/projects/375c2a9259ef42fda2c12080e4b0bf94 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:16.968625 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f87e7-4df1-40e2-a559-91c05652bb47 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:16.969282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f87e7-4df1-40e2-a559-91c05652bb47 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:16.969754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f87e7-4df1-40e2-a559-91c05652bb47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.008923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a96f87e7-4df1-40e2-a559-91c05652bb47 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:17.010441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a96f87e7-4df1-40e2-a559-91c05652bb47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:17.121020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b521-9d8a-4858-81f0-b99357824539 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.121369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b521-9d8a-4858-81f0-b99357824539 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.122297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7099b521-9d8a-4858-81f0-b99357824539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.123496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1103/2212] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:17.167579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7099b521-9d8a-4858-81f0-b99357824539 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:17.170921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7099b521-9d8a-4858-81f0-b99357824539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:17.191709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1110/2213] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:17.197794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f87e7-4df1-40e2-a559-91c05652bb47 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.211211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f87e7-4df1-40e2-a559-91c05652bb47 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:17.217595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:17.223480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.223975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.224403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.225476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:17.225797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:17.227763 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:17.252749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b521-9d8a-4858-81f0-b99357824539 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.259601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1104/2214] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:17.264618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7099b521-9d8a-4858-81f0-b99357824539 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:17.271893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:17.272745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.273174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.273620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.274698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:17.279689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:17.455853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1111/2215] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:17 2022] POST /identity/v3/projects => generated 371 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:17.460905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.477447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e46c26d-2cb1-4a24-a6ab-8d273122686c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:17.603291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:17.604377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.604662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.604932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.605604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:17.609449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:17.735584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1105/2216] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:17 2022] POST /identity/v3/users => generated 286 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:17.739846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.750449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f677-4b88-4546-bf53-06f528e4831e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:17.756628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:17.757413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.760611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.761135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.762537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:17.764247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:17.782299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.786666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1112/2217] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:17.797318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f3baed-b787-4593-99fc-5cac07897ce5 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:17.804786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de5c3a-91f7-4594-9b47-478ac43b67d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:17.805419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5c3a-91f7-4594-9b47-478ac43b67d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.805745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5c3a-91f7-4594-9b47-478ac43b67d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.806053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de5c3a-91f7-4594-9b47-478ac43b67d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.806748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5c3a-91f7-4594-9b47-478ac43b67d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:17.808414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9de5c3a-91f7-4594-9b47-478ac43b67d7 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:17.823134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1106/2218] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:17.828218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:17.846317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51768474-ba81-4d02-a048-09cfd73433e7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:17.854163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:17.854845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:17.855123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:17.855395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] PATH_INFO: `/v3/projects/8df43b7e27da486b8cc1c729de7dd3b8/users/d6819f3ee07842dbbbc20470a8909c71/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:17.879464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8df43b7e27da486b8cc1c729de7dd3b8, user_id=d6819f3ee07842dbbbc20470a8909c71, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:17.882561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.079586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1113/2219] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:17 2022] PUT /identity/v3/projects/8df43b7e27da486b8cc1c729de7dd3b8/users/d6819f3ee07842dbbbc20470a8909c71/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:18.080812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d35e-4ac9-4aa9-9188-3694797c17eb None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.081186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d35e-4ac9-4aa9-9188-3694797c17eb None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.081527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84d35e-4ac9-4aa9-9188-3694797c17eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.127421 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6d84d35e-4ac9-4aa9-9188-3694797c17eb None None] MFA Rules not processed for user `d6819f3ee07842dbbbc20470a8909c71`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:18.129641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6d84d35e-4ac9-4aa9-9188-3694797c17eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:18.240037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1107/2220] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:18.252649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:18.254706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:18.333885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067edd8a-8be9-4a7d-a698-de3068ea9119 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:18.338314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:18.339052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:18.339465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:18.340853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:18.354674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:18.357415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:18.369628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1114/2221] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:19.310631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:19.792913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:19.793522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:19.793716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:19.883061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] MFA Rules not processed for user `2b323955c030440faeed55bfe618db8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:19.884539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:20.013994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1108/2222] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:19 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:20.028875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:20.030379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:20.166971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:20.167496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492a3464-a7df-4647-9ace-8ceb57e6c574 service glance] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:20.178238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f712e0-4c94-470e-a19e-fc803e2a1b1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:20.179140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f712e0-4c94-470e-a19e-fc803e2a1b1d service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:20.179893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f712e0-4c94-470e-a19e-fc803e2a1b1d service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:20.180369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f712e0-4c94-470e-a19e-fc803e2a1b1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:20.185174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c5f712e0-4c94-470e-a19e-fc803e2a1b1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:20.281257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f712e0-4c94-470e-a19e-fc803e2a1b1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:20.283449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f712e0-4c94-470e-a19e-fc803e2a1b1d service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:20.302205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1115/2223] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:21.339936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:21.342248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:21.450162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e53c1-8ef5-48e0-ac7b-4d54853adbba None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:21.471058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:21.472408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.472700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.472986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] PATH_INFO: `/v3/users/e6bbdf3c659c4b36a17875f1a5a3c069` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.474660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6bbdf3c659c4b36a17875f1a5a3c069)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:21.477210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:21.767249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6bbdf3c659c4b36a17875f1a5a3c069'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:21.880675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6bbdf3c659c4b36a17875f1a5a3c069'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:21.890870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6bbdf3c659c4b36a17875f1a5a3c069'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:21.921875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6bbdf3c659c4b36a17875f1a5a3c069'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:21.922911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6bbdf3c659c4b36a17875f1a5a3c069'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:21.930006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1109/2224] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:21 2022] DELETE /identity/v3/users/e6bbdf3c659c4b36a17875f1a5a3c069 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:21.935089 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:21.935591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:21.935685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:21.957656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:21.959770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:22.066144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1116/2225] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:22.078004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:22.079820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:22.215570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1039f6ed-031c-4ee0-984f-a2d1d3bae080 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:22.239215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:22.244268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:22.244642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:22.245001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:22.267716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:22.269394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:22.282137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1110/2226] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:22.401063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:23.126594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.129654 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:23.190192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae51996-f631-49d2-80cf-8718d2f63dba None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.196047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.196709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.197118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.197583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] PATH_INFO: `/v3/projects/8740f89903a84a208df51223d13c46f5` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.199833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8740f89903a84a208df51223d13c46f5)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.203440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:23.206138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:23.417137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8740f89903a84a208df51223d13c46f5', 'request_id': 'req-19e3eb8f-3ad6-48ba-8c95-469081235a6a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:23.466344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8740f89903a84a208df51223d13c46f5', 'request_id': 'req-19e3eb8f-3ad6-48ba-8c95-469081235a6a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:23.514231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8740f89903a84a208df51223d13c46f5', 'request_id': 'req-19e3eb8f-3ad6-48ba-8c95-469081235a6a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:23.659389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] The token cache is being invalidate because project 8740f89903a84a208df51223d13c46f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:23.659813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:23.662628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:23.669468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1117/2227] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:23 2022] DELETE /identity/v3/projects/8740f89903a84a208df51223d13c46f5 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:23.679465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:23.686955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f90818-24f0-4edd-8702-b11272dd167f service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:23.923309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:23.924024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:23.924309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:23.927045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] PATH_INFO: `/v3/users/e0c2a6e031794ef5b5c3ef5fa053038f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:23.929493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0c2a6e031794ef5b5c3ef5fa053038f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:23.932319 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:24.207054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0c2a6e031794ef5b5c3ef5fa053038f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:24.275640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0c2a6e031794ef5b5c3ef5fa053038f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:24.286423 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0c2a6e031794ef5b5c3ef5fa053038f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:24.309817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0c2a6e031794ef5b5c3ef5fa053038f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:24.310804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-92856a3b-5c1a-4319-ad4f-ca20734091ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0c2a6e031794ef5b5c3ef5fa053038f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:24.318606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1111/2228] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:23 2022] DELETE /identity/v3/users/e0c2a6e031794ef5b5c3ef5fa053038f => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:24.820069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:24.821696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:24.845531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3eb8f-3ad6-48ba-8c95-469081235a6a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:24.942372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:24.942372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:24.942372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:24.942372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] PATH_INFO: `/v3/projects/eb9365b2fc7b46e9833fe54b37d45266` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:24.942720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9365b2fc7b46e9833fe54b37d45266)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:24.942720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:25.076474 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9365b2fc7b46e9833fe54b37d45266', 'request_id': 'req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:25.083040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9365b2fc7b46e9833fe54b37d45266', 'request_id': 'req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:25.094467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9365b2fc7b46e9833fe54b37d45266', 'request_id': 'req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:25.227585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] The token cache is being invalidate because project eb9365b2fc7b46e9833fe54b37d45266 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:25.227901 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:25.228743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d50142c9-ad00-4ce7-a87b-ad56fb308e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:25.230350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1118/2229] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:24 2022] DELETE /identity/v3/projects/eb9365b2fc7b46e9833fe54b37d45266 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:25.235986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2757-afc9-4e6f-8d50-008bdefbbdae None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.236459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2757-afc9-4e6f-8d50-008bdefbbdae None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.236572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dd2757-afc9-4e6f-8d50-008bdefbbdae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.260235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e3dd2757-afc9-4e6f-8d50-008bdefbbdae None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:25.262034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e3dd2757-afc9-4e6f-8d50-008bdefbbdae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:25.367283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1112/2230] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:25.379421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ccb0d-4ce4-46ea-8718-d3c0273f76e4 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.379834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ccb0d-4ce4-46ea-8718-d3c0273f76e4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.380213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ccb0d-4ce4-46ea-8718-d3c0273f76e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.391893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:25.410844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-cb1ccb0d-4ce4-46ea-8718-d3c0273f76e4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:25.412273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cb1ccb0d-4ce4-46ea-8718-d3c0273f76e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:25.569455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1119/2231] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:25.570864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2757-afc9-4e6f-8d50-008bdefbbdae None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:25.570864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dd2757-afc9-4e6f-8d50-008bdefbbdae None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:25.570864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:25.570864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.571214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.571214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.571214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:25.571214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:25.571214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:25.571214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1113/2232] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:25.571675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ccb0d-4ce4-46ea-8718-d3c0273f76e4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:25.571675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ccb0d-4ce4-46ea-8718-d3c0273f76e4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:25.571675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:25.571675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:25.572034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:25.572034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:25.572034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:25.572034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.049193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1120/2233] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:25 2022] POST /identity/v3/projects => generated 365 bytes in 559 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:26.053694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.066523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3355c0-6c6e-4131-9e3c-5c467cc597d1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.125564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.126222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.126502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.126775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.127440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.129409 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.319567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.330056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1114/2234] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:26 2022] POST /identity/v3/users => generated 283 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:26.349388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae89e10e-7629-4d92-9ef8-878786cf043f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.349388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.349388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.349388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.349869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.349869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.349869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.367396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1121/2235] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:26.371551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.383438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f88f1f9-21cd-441a-83f7-e9db753e9ca3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.398691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7403bdf-8209-4033-9818-539a180bee89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.399830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7403bdf-8209-4033-9818-539a180bee89 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.400485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7403bdf-8209-4033-9818-539a180bee89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.400979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7403bdf-8209-4033-9818-539a180bee89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.401939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7403bdf-8209-4033-9818-539a180bee89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.404482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7403bdf-8209-4033-9818-539a180bee89 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.416853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1115/2236] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:26.421167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.431202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa3de82-d276-4c85-a734-36c68cf02c4a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.436325 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.436989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.437283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.437557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] PATH_INFO: `/v3/projects/52fe036d37934c38892eb340f7427b09/users/f1abbbc158e543bd9c3e96c2b9078ed9/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.463590 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52fe036d37934c38892eb340f7427b09, user_id=f1abbbc158e543bd9c3e96c2b9078ed9, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.466762 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.583903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1122/2237] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:26 2022] PUT /identity/v3/projects/52fe036d37934c38892eb340f7427b09/users/f1abbbc158e543bd9c3e96c2b9078ed9/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:26.594644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f1cf-c7a3-4d6b-9b2d-366836575377 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.594926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f1cf-c7a3-4d6b-9b2d-366836575377 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.595200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962f1cf-c7a3-4d6b-9b2d-366836575377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.624288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-5962f1cf-c7a3-4d6b-9b2d-366836575377 None None] MFA Rules not processed for user `f1abbbc158e543bd9c3e96c2b9078ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:26.625481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5962f1cf-c7a3-4d6b-9b2d-366836575377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:26.632075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:26.697541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1116/2238] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:26 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:26.701793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.765263 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72396038-9617-4cbc-8b56-a6008cad2713 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:26.770647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:26.771308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:26.771621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:26.772058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:26.772754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:26.775232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:26.973898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1123/2239] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:26 2022] POST /identity/v3/projects => generated 369 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:26.981424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f1cf-c7a3-4d6b-9b2d-366836575377 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:26.992116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962f1cf-c7a3-4d6b-9b2d-366836575377 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.051261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.051894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.052178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.052484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.053182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.055182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.134237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1117/2240] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:26 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:27.140342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.156747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c2ff8d-5944-468b-916d-2e9933707d36 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.161966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.162587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.162874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.163150 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.163851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.165560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.178149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1124/2241] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:26:27.182139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.192778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019e71-335c-405e-b606-fce8c39508fa admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.197436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.198158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.198457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.198726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] PATH_INFO: `/v3/projects/8ac2f4f56ad54267b762851b37aa6d10/users/4fa0e45ad99c4623b33d18cff2c1b827/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.220988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac2f4f56ad54267b762851b37aa6d10, user_id=4fa0e45ad99c4623b33d18cff2c1b827, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.223902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.316921 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1118/2242] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:27 2022] PUT /identity/v3/projects/8ac2f4f56ad54267b762851b37aa6d10/users/4fa0e45ad99c4623b33d18cff2c1b827/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:27.323443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.336214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676c4037-5e46-4d2d-95cf-562e6e1f38fc admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.392801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e9ecc-fbaf-434d-9787-dfeab1336bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.393457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e9ecc-fbaf-434d-9787-dfeab1336bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.393729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e9ecc-fbaf-434d-9787-dfeab1336bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.394028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e9ecc-fbaf-434d-9787-dfeab1336bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.394710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e9ecc-fbaf-434d-9787-dfeab1336bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.396284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e9ecc-fbaf-434d-9787-dfeab1336bb2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.406386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1125/2243] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:27.410833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.424202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4c18cf-aa73-408d-b3ab-d8c390305ef0 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.430088 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.430850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.431079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.431309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] PATH_INFO: `/v3/projects/8ac2f4f56ad54267b762851b37aa6d10/users/4fa0e45ad99c4623b33d18cff2c1b827/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.433312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ac2f4f56ad54267b762851b37aa6d10, user_id=4fa0e45ad99c4623b33d18cff2c1b827, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.435971 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.446604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1119/2244] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:27 2022] PUT /identity/v3/projects/8ac2f4f56ad54267b762851b37aa6d10/users/4fa0e45ad99c4623b33d18cff2c1b827/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:27.458959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.459249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.459521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.491725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] MFA Rules not processed for user `4fa0e45ad99c4623b33d18cff2c1b827`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:27.492947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:27.574976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1126/2245] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:27 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:27.585729 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:27.588055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:27.647230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac880a3-ea4d-4440-a266-d5aebfa7e3cb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:27.650878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35b2ead-1cca-4747-b5cb-f10f98fb634e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:27.651488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2ead-1cca-4747-b5cb-f10f98fb634e service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:27.651761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2ead-1cca-4747-b5cb-f10f98fb634e service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:27.652648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35b2ead-1cca-4747-b5cb-f10f98fb634e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:27.662326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2ead-1cca-4747-b5cb-f10f98fb634e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:27.664310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35b2ead-1cca-4747-b5cb-f10f98fb634e service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:27.676961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1120/2246] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:27 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:28.618349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:28.643636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:28.645265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:28.721189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04345d93-f008-4fd8-be73-904f58e2bc14 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:28.727691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:28.728336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:28.728691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:28.729096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] PATH_INFO: `/v3/users/c3e703605a14484c87ab827d746eea47` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:28.732334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3e703605a14484c87ab827d746eea47)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:28.734299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:28.799559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:28.943077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3e703605a14484c87ab827d746eea47'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:28.944129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3e703605a14484c87ab827d746eea47'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:28.959797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3e703605a14484c87ab827d746eea47'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:28.961650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3e703605a14484c87ab827d746eea47'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:29.064894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3e703605a14484c87ab827d746eea47'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:29.086724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1127/2247] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:28 2022] DELETE /identity/v3/users/c3e703605a14484c87ab827d746eea47 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:29.092301 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:29.092584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:29.092853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:29.112059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:29.113228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:29.219960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1121/2248] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:29.239407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:29.240832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:29.334194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c162b0e-7de8-4f34-9a84-beb1c776ce3d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:29.347652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:29.348293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:29.348767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:29.349164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:29.367359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:29.372220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:29.390744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1128/2249] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:29.913900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:29.916625 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:29.931434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c1ca1-c938-4775-a882-785ef032a4b5 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:29.936459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:29.937303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:29.937584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:29.938093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] PATH_INFO: `/v3/projects/da062c3ac660484bbc7e0370e747e625` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:29.939503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da062c3ac660484bbc7e0370e747e625)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:29.941930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:30.050048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da062c3ac660484bbc7e0370e747e625', 'request_id': 'req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:30.194510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da062c3ac660484bbc7e0370e747e625', 'request_id': 'req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:30.201544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da062c3ac660484bbc7e0370e747e625', 'request_id': 'req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:30.213556 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] The token cache is being invalidate because project da062c3ac660484bbc7e0370e747e625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:30.214131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:30.214839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c28fd3b5-14c5-47e5-8202-b2dc9c0776f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:30.216380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1122/2250] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:29 2022] DELETE /identity/v3/projects/da062c3ac660484bbc7e0370e747e625 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:31.114516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:31.434884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:31.457758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:31.459231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:31.474681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b13ad7-8bef-4c27-a9d9-f5dd8f82b644 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:31.537216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:31.537902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.538189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.538466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] PATH_INFO: `/v3/users/f1abbbc158e543bd9c3e96c2b9078ed9` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.539841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1abbbc158e543bd9c3e96c2b9078ed9)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:31.542990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:31.551573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e98c3d-e931-430d-9f01-bc26752c6c2d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.551965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e98c3d-e931-430d-9f01-bc26752c6c2d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.552340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e98c3d-e931-430d-9f01-bc26752c6c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.571455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-23e98c3d-e931-430d-9f01-bc26752c6c2d None None] MFA Rules not processed for user `c25ffc3341b34fae80a7842c0b0fdbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:31.572849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-23e98c3d-e931-430d-9f01-bc26752c6c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:31.632179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1123/2251] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:31.827043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1abbbc158e543bd9c3e96c2b9078ed9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:31.833744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1abbbc158e543bd9c3e96c2b9078ed9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:31.857802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1abbbc158e543bd9c3e96c2b9078ed9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:31.859525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1abbbc158e543bd9c3e96c2b9078ed9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:31.920122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1abbbc158e543bd9c3e96c2b9078ed9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:31.936430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1129/2252] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:31 2022] DELETE /identity/v3/users/f1abbbc158e543bd9c3e96c2b9078ed9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:31.941060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:31.941710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:31.942042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:31.967374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:31.968641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:32.038059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1124/2253] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:32.048685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:32.050543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:32.131359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb37a2-3086-4202-98d8-9d316ab27b56 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:32.137402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:32.137402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:32.137402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:32.137402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:32.146012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:32.147538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:32.157275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1130/2254] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:32.636756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:32.638266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:32.650342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b697e52-bc09-4611-b23d-9800360a15f8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:32.656502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:32.657156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:32.657435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:32.657708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] PATH_INFO: `/v3/projects/52fe036d37934c38892eb340f7427b09` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:32.658914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52fe036d37934c38892eb340f7427b09)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:32.660826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:32.887426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52fe036d37934c38892eb340f7427b09', 'request_id': 'req-4a78e071-53de-421f-a49a-5eab06499f2e'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:32.935984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52fe036d37934c38892eb340f7427b09', 'request_id': 'req-4a78e071-53de-421f-a49a-5eab06499f2e'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:32.945140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52fe036d37934c38892eb340f7427b09', 'request_id': 'req-4a78e071-53de-421f-a49a-5eab06499f2e'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:32.957814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] The token cache is being invalidate because project 52fe036d37934c38892eb340f7427b09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:32.958184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:32.959009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:32.960830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1125/2255] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:32 2022] DELETE /identity/v3/projects/52fe036d37934c38892eb340f7427b09 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:32.970406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:33.000741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c0ba38-dd62-424a-a2ba-4c81d595e54a service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:33.073529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:33.074496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:33.074993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:33.075340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] PATH_INFO: `/v3/users/4fa0e45ad99c4623b33d18cff2c1b827` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:33.077411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fa0e45ad99c4623b33d18cff2c1b827)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:33.079702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:33.153107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:33.317866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fa0e45ad99c4623b33d18cff2c1b827'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:33.318526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fa0e45ad99c4623b33d18cff2c1b827'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:33.335642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fa0e45ad99c4623b33d18cff2c1b827'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:33.335642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fa0e45ad99c4623b33d18cff2c1b827'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:33.406229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:33.432999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-71c48cad-f583-46d2-8607-703162dc6290 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fa0e45ad99c4623b33d18cff2c1b827'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:33.446596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1131/2256] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:32 2022] DELETE /identity/v3/users/4fa0e45ad99c4623b33d18cff2c1b827 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:33.896724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:33.898813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:33.914960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a78e071-53de-421f-a49a-5eab06499f2e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:33.970341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:33.970979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:33.971257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:33.971529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] PATH_INFO: `/v3/projects/8ac2f4f56ad54267b762851b37aa6d10` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:33.972669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ac2f4f56ad54267b762851b37aa6d10)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:33.974597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:34.126313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ac2f4f56ad54267b762851b37aa6d10', 'request_id': 'req-9ce44222-bf8e-47de-b46b-c63505064450'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:34.194030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ac2f4f56ad54267b762851b37aa6d10', 'request_id': 'req-9ce44222-bf8e-47de-b46b-c63505064450'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:34.200909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ac2f4f56ad54267b762851b37aa6d10', 'request_id': 'req-9ce44222-bf8e-47de-b46b-c63505064450'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:34.220557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] The token cache is being invalidate because project 8ac2f4f56ad54267b762851b37aa6d10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:34.220914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:34.221681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9ce44222-bf8e-47de-b46b-c63505064450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:34.223308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1126/2257] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:33 2022] DELETE /identity/v3/projects/8ac2f4f56ad54267b762851b37aa6d10 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:34.230376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c3eec-6bd8-4b67-9984-88b2ae769e9f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.230863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c3eec-6bd8-4b67-9984-88b2ae769e9f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.233432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c3eec-6bd8-4b67-9984-88b2ae769e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.261534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-928c3eec-6bd8-4b67-9984-88b2ae769e9f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:34.263706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-928c3eec-6bd8-4b67-9984-88b2ae769e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:34.336327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1132/2258] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:34.344989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b3fc-171a-4dab-94a6-1e9b1697b9de None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.345273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b3fc-171a-4dab-94a6-1e9b1697b9de None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.345549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205b3fc-171a-4dab-94a6-1e9b1697b9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.372184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6205b3fc-171a-4dab-94a6-1e9b1697b9de None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:34.373403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6205b3fc-171a-4dab-94a6-1e9b1697b9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:34.386771 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1127/2259] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:34.388117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c3eec-6bd8-4b67-9984-88b2ae769e9f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:34.400251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c3eec-6bd8-4b67-9984-88b2ae769e9f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:34.406682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:34.407522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.407829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.408298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.409365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:34.413024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:34.415345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:34.436472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1133/2260] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:34.443891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205b3fc-171a-4dab-94a6-1e9b1697b9de None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:34.460015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205b3fc-171a-4dab-94a6-1e9b1697b9de None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:34.467184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:34.468095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.468558 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.468981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.469853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:34.472283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:34.612894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1128/2261] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:34 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:34.617017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:34.627667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74188583-9fb0-4d59-8ba0-b15c1857a5d1 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:34.692308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:34.692929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.696216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.696216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.696216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:34.697019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:34.779047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1134/2262] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:34 2022] POST /identity/v3/users => generated 284 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:34.783284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:34.793475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e08ecfe-48b3-4950-99b7-68f8958d94ca admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:34.798168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:34.798767 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.799045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.799316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.799996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:34.801606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:34.812085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1129/2263] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:34.816059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:34.826811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23c94d2-bf48-439f-90ee-ddd00771742d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:34.831573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ba3a5-63f5-49a5-a289-b548c44957d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:34.832266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ba3a5-63f5-49a5-a289-b548c44957d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.832491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ba3a5-63f5-49a5-a289-b548c44957d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.832768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ba3a5-63f5-49a5-a289-b548c44957d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.833536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ba3a5-63f5-49a5-a289-b548c44957d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:34.834451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:34.837932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ba3a5-63f5-49a5-a289-b548c44957d9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:34.846535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1135/2264] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:34.851084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:34.866665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db96d2-4a5b-4c29-ab96-19d2c07aa9f3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:34.869746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:34.871015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.872004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.872094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] PATH_INFO: `/v3/projects/bc9280d3147546a583673f2929dfec43/users/005ba3083ef248be8ecb39162f2a60ef/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:34.892873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc9280d3147546a583673f2929dfec43, user_id=005ba3083ef248be8ecb39162f2a60ef, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:34.897903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:34.975794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1130/2265] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:34 2022] PUT /identity/v3/projects/bc9280d3147546a583673f2929dfec43/users/005ba3083ef248be8ecb39162f2a60ef/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:34.986747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968450d-3383-4c50-b7f6-82eec7e675ff None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:34.987307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968450d-3383-4c50-b7f6-82eec7e675ff None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:34.987734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968450d-3383-4c50-b7f6-82eec7e675ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.017112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4968450d-3383-4c50-b7f6-82eec7e675ff None None] MFA Rules not processed for user `005ba3083ef248be8ecb39162f2a60ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:35.018952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4968450d-3383-4c50-b7f6-82eec7e675ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:35.090989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1136/2266] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:34 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:35.095749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:35.103603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:35.169655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545d89-bf73-4279-8c0c-46920f0bc67f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:35.174165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:35.174772 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.175046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.175315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.176008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:35.177925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:35.262668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1131/2267] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:35 2022] POST /identity/v3/projects => generated 367 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:26:35.264894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968450d-3383-4c50-b7f6-82eec7e675ff None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:35.278507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968450d-3383-4c50-b7f6-82eec7e675ff None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:35.344507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:35.345187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.345520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.345838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.346507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:35.348449 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:35.503181 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1137/2268] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:35 2022] POST /identity/v3/users => generated 290 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:35.507126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:35.518678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35b1d1-1e38-4516-83ee-ac076a2c5a96 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:35.523264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:35.524095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.524482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.524836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.525596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:35.527285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:35.537946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1132/2269] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:35.542513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:35.552718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d26ca1c-6f64-4ea2-831d-39cee8e9efa6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:35.557520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:35.558762 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.561271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.561271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] PATH_INFO: `/v3/projects/a00fca0c2ac3417c8ede8b8d855a553c/users/4042646816e149c3aeb60f17db5f4827/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.576316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00fca0c2ac3417c8ede8b8d855a553c, user_id=4042646816e149c3aeb60f17db5f4827, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:35.579137 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:35.721080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1138/2270] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:35 2022] PUT /identity/v3/projects/a00fca0c2ac3417c8ede8b8d855a553c/users/4042646816e149c3aeb60f17db5f4827/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:35.725336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:35.735436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b7e28f-78c1-4728-a10a-cc2337053277 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:35.791766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9119365e-d5ed-4923-a600-9bd22c81cd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:35.792385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119365e-d5ed-4923-a600-9bd22c81cd96 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.792663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119365e-d5ed-4923-a600-9bd22c81cd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.792933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9119365e-d5ed-4923-a600-9bd22c81cd96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.793618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119365e-d5ed-4923-a600-9bd22c81cd96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:35.795311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9119365e-d5ed-4923-a600-9bd22c81cd96 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:35.805427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1133/2271] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:35.809861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:35.820080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e19ac9-c2ff-4d4b-a373-f43da155331b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:35.825425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:35.826140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.826422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.826690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] PATH_INFO: `/v3/projects/a00fca0c2ac3417c8ede8b8d855a553c/users/4042646816e149c3aeb60f17db5f4827/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.828690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00fca0c2ac3417c8ede8b8d855a553c, user_id=4042646816e149c3aeb60f17db5f4827, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:35.831568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:35.842856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1139/2272] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:35 2022] PUT /identity/v3/projects/a00fca0c2ac3417c8ede8b8d855a553c/users/4042646816e149c3aeb60f17db5f4827/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:35.854425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bbe1d-a950-4f28-97e9-4d0b57d92fc9 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:35.854713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bbe1d-a950-4f28-97e9-4d0b57d92fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:35.854985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5bbe1d-a950-4f28-97e9-4d0b57d92fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:35.883757 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9c5bbe1d-a950-4f28-97e9-4d0b57d92fc9 None None] MFA Rules not processed for user `4042646816e149c3aeb60f17db5f4827`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:35.885026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9c5bbe1d-a950-4f28-97e9-4d0b57d92fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:35.958303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1134/2273] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:35.971751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:35.973598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:36.059705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bf0f5-fb5d-478d-9860-1dafb3578cc8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:36.064290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290593c8-769c-48a9-9a05-2160c1082371 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:36.064939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290593c8-769c-48a9-9a05-2160c1082371 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.065213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290593c8-769c-48a9-9a05-2160c1082371 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.065483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290593c8-769c-48a9-9a05-2160c1082371 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.076520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290593c8-769c-48a9-9a05-2160c1082371 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:36.078070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290593c8-769c-48a9-9a05-2160c1082371 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:36.091314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1140/2274] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:36.121009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:36.333831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bbe1d-a950-4f28-97e9-4d0b57d92fc9 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:36.344016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5bbe1d-a950-4f28-97e9-4d0b57d92fc9 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:36.347713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee09e0-c9ad-4afb-a372-168af2e8b368 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:36.348326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee09e0-c9ad-4afb-a372-168af2e8b368 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.348601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee09e0-c9ad-4afb-a372-168af2e8b368 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.348868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee09e0-c9ad-4afb-a372-168af2e8b368 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.405781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee09e0-c9ad-4afb-a372-168af2e8b368 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:36.407193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee09e0-c9ad-4afb-a372-168af2e8b368 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:36.417052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1135/2275] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:36 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:36.786125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:36.786937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:36.787195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:36.805692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:36.807587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] MFA Rules not processed for user `8bbfd4cdd3ba4066ab933f00433c8164`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:36.809475 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:36.864861 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1141/2276] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:37.405618 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:38.491239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:38.914653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b9c9-36b8-4bab-a2a4-c63434ca1ae6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:38.915204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b9c9-36b8-4bab-a2a4-c63434ca1ae6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:38.915204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c803b9c9-36b8-4bab-a2a4-c63434ca1ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:38.920774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:38.938702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c803b9c9-36b8-4bab-a2a4-c63434ca1ae6 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:38.939948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c803b9c9-36b8-4bab-a2a4-c63434ca1ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:39.014083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1136/2277] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:26:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:39.074741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:39.076272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:39.158247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085d60a-8c1c-4d78-829a-71c60e54092b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:39.166113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5710464-cc5d-4762-a685-00d82a0e1c32 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:39.166969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5710464-cc5d-4762-a685-00d82a0e1c32 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:39.168298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5710464-cc5d-4762-a685-00d82a0e1c32 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:39.169224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5710464-cc5d-4762-a685-00d82a0e1c32 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:39.182077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5710464-cc5d-4762-a685-00d82a0e1c32 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:39.184574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5710464-cc5d-4762-a685-00d82a0e1c32 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:39.196102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1142/2278] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:26:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:26:39.406272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:45.240492 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b9c9-36b8-4bab-a2a4-c63434ca1ae6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:45.397254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c803b9c9-36b8-4bab-a2a4-c63434ca1ae6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:45.413614 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:45.414458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:45.414743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:45.415285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] PATH_INFO: `/v3/users/005ba3083ef248be8ecb39162f2a60ef` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:45.417274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=005ba3083ef248be8ecb39162f2a60ef)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:45.419713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:45.704783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:45.720624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005ba3083ef248be8ecb39162f2a60ef'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:45.788045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005ba3083ef248be8ecb39162f2a60ef'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:45.801307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005ba3083ef248be8ecb39162f2a60ef'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:45.817938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005ba3083ef248be8ecb39162f2a60ef'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:45.826646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005ba3083ef248be8ecb39162f2a60ef'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:45.826646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1137/2279] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:45 2022] DELETE /identity/v3/users/005ba3083ef248be8ecb39162f2a60ef => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:45.829779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:45.830301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:45.830414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:45.865188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:45.867111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:45.977940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1143/2280] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:45.984408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:45.986005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:46.146067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88edfd4e-c9af-4704-b3d2-4d2c01809145 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:46.155247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:46.161627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:46.161627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:46.161627 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:46.188431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:46.189998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:46.218702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1138/2281] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:46.851772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:46.853220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:46.878644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5152154-c42c-478e-b49d-151f1b1f57fb None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:46.884462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:46.885273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:46.886023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:46.886309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] PATH_INFO: `/v3/projects/bc9280d3147546a583673f2929dfec43` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:46.887695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc9280d3147546a583673f2929dfec43)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:46.890113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:46.994018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:47.001626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc9280d3147546a583673f2929dfec43', 'request_id': 'req-91b7bc62-d835-4c80-bb7d-2506f598cd1c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.007331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc9280d3147546a583673f2929dfec43', 'request_id': 'req-91b7bc62-d835-4c80-bb7d-2506f598cd1c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.015256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc9280d3147546a583673f2929dfec43', 'request_id': 'req-91b7bc62-d835-4c80-bb7d-2506f598cd1c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.119309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] The token cache is being invalidate because project bc9280d3147546a583673f2929dfec43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:47.119666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.120303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.121950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1144/2282] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:46 2022] DELETE /identity/v3/projects/bc9280d3147546a583673f2929dfec43 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:47.127875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:47.142308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656f4f2b-10da-4569-8bee-f567b09daa25 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:47.232379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:47.233028 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:47.233849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:47.234138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] PATH_INFO: `/v3/users/4042646816e149c3aeb60f17db5f4827` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:47.235571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4042646816e149c3aeb60f17db5f4827)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:47.242147 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:47.512740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4042646816e149c3aeb60f17db5f4827'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.593049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4042646816e149c3aeb60f17db5f4827'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.598995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:47.603214 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4042646816e149c3aeb60f17db5f4827'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.632025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4042646816e149c3aeb60f17db5f4827'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.632025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-733b0a46-5c8c-4d82-9188-e08f4402691d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4042646816e149c3aeb60f17db5f4827'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:47.641751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1139/2283] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:47 2022] DELETE /identity/v3/users/4042646816e149c3aeb60f17db5f4827 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:48.212562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:48.215662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:48.234155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7bc62-d835-4c80-bb7d-2506f598cd1c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:48.309302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:48.310007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:48.310294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:48.310565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] PATH_INFO: `/v3/projects/a00fca0c2ac3417c8ede8b8d855a553c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:48.311732 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00fca0c2ac3417c8ede8b8d855a553c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:48.313706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:48.480469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00fca0c2ac3417c8ede8b8d855a553c', 'request_id': 'req-39e6d9d4-9953-4677-a065-01b993c1c4a1'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:48.490294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00fca0c2ac3417c8ede8b8d855a553c', 'request_id': 'req-39e6d9d4-9953-4677-a065-01b993c1c4a1'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:48.502226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00fca0c2ac3417c8ede8b8d855a553c', 'request_id': 'req-39e6d9d4-9953-4677-a065-01b993c1c4a1'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:48.609839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] The token cache is being invalidate because project a00fca0c2ac3417c8ede8b8d855a553c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:48.612312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:48.615479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-39e6d9d4-9953-4677-a065-01b993c1c4a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:48.623308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1145/2284] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:48 2022] DELETE /identity/v3/projects/a00fca0c2ac3417c8ede8b8d855a553c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:48.625792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9883-8b64-4dc1-87a6-bed9b52a6572 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:48.626809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9883-8b64-4dc1-87a6-bed9b52a6572 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:48.627093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb9883-8b64-4dc1-87a6-bed9b52a6572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:48.665886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e4eb9883-8b64-4dc1-87a6-bed9b52a6572 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:48.669438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e4eb9883-8b64-4dc1-87a6-bed9b52a6572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:48.796670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1140/2285] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:48.805270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763f84-f3ef-401f-a48c-1822b2d4b6cc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:48.805596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763f84-f3ef-401f-a48c-1822b2d4b6cc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:48.805883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6763f84-f3ef-401f-a48c-1822b2d4b6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:48.842310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-d6763f84-f3ef-401f-a48c-1822b2d4b6cc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:48.843254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d6763f84-f3ef-401f-a48c-1822b2d4b6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:48.856746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1146/2286] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:48.858181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9883-8b64-4dc1-87a6-bed9b52a6572 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:48.872547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb9883-8b64-4dc1-87a6-bed9b52a6572 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:48.878306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:48.881029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:48.881029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:48.881029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:48.881029 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:48.881413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:48.884118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:48.907161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1141/2287] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:48.911607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6763f84-f3ef-401f-a48c-1822b2d4b6cc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:48.921252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6763f84-f3ef-401f-a48c-1822b2d4b6cc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:48.926234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:48.926849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:48.927123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:48.927390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:48.928051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:48.930021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:49.041680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1147/2288] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:48 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:49.046789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:49.063018 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4bee1-c966-41d3-a4a3-be8f593d76eb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:49.123227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:49.123842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:49.124120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:49.124391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:49.125071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:49.127120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:49.239020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1142/2289] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:49 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:49.243142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:49.253218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a793e9c-6e62-4d4f-8a76-197d8d3dddf2 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:49.257747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:49.258400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:49.258678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:49.258947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:49.259625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:49.261699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:49.271650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1148/2290] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:49.275406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:49.285512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b576b220-dd94-435c-ac5f-f7bfbc2263e6 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:49.290167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42eefa4-f3e9-4e44-9aff-8368462cc6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:49.290815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eefa4-f3e9-4e44-9aff-8368462cc6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:49.291044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eefa4-f3e9-4e44-9aff-8368462cc6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:49.291872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42eefa4-f3e9-4e44-9aff-8368462cc6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:49.292565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eefa4-f3e9-4e44-9aff-8368462cc6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:49.294172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42eefa4-f3e9-4e44-9aff-8368462cc6c7 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:49.304281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1143/2291] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:49.308874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:49.318942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab22e6-75fa-4d09-862d-44b45deb419e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:49.323603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:49.324276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:49.324558 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:49.324835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] PATH_INFO: `/v3/projects/43356e73ba6f418a81c4e94e7c76bf15/users/18a22900410a479796a3d3e6a6d7efb3/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:49.340709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43356e73ba6f418a81c4e94e7c76bf15, user_id=18a22900410a479796a3d3e6a6d7efb3, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:49.343407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:49.345618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:49.427730 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1149/2292] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:49 2022] PUT /identity/v3/projects/43356e73ba6f418a81c4e94e7c76bf15/users/18a22900410a479796a3d3e6a6d7efb3/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:49.439950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4584e-488a-46a5-85b1-4002d4cf2163 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:49.440233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4584e-488a-46a5-85b1-4002d4cf2163 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:49.440507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4584e-488a-46a5-85b1-4002d4cf2163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:49.468194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-49b4584e-488a-46a5-85b1-4002d4cf2163 None None] MFA Rules not processed for user `18a22900410a479796a3d3e6a6d7efb3`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:49.469389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-49b4584e-488a-46a5-85b1-4002d4cf2163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:49.498861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:49.531963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1144/2293] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:49.544038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:49.545698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:49.601506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df00d3cd-cfd8-4f24-b3f6-93c3ef93fe85 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:49.605174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774b1f41-8b2b-4d0b-94eb-6785f9a56a4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:49.605813 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1f41-8b2b-4d0b-94eb-6785f9a56a4c service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:49.606095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1f41-8b2b-4d0b-94eb-6785f9a56a4c service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:49.606367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774b1f41-8b2b-4d0b-94eb-6785f9a56a4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:49.614471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b1f41-8b2b-4d0b-94eb-6785f9a56a4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:49.615895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774b1f41-8b2b-4d0b-94eb-6785f9a56a4c service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:49.624984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1150/2294] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:49.644844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4584e-488a-46a5-85b1-4002d4cf2163 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:49.704505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4584e-488a-46a5-85b1-4002d4cf2163 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:49.709121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:49.709787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:49.710055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:49.710328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] PATH_INFO: `/v3/users/18a22900410a479796a3d3e6a6d7efb3` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:49.711483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a22900410a479796a3d3e6a6d7efb3)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:49.713679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:49.938392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a22900410a479796a3d3e6a6d7efb3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.004422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a22900410a479796a3d3e6a6d7efb3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.012162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a22900410a479796a3d3e6a6d7efb3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.024440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a22900410a479796a3d3e6a6d7efb3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.025260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a22900410a479796a3d3e6a6d7efb3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.031962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1145/2295] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:49 2022] DELETE /identity/v3/users/18a22900410a479796a3d3e6a6d7efb3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:50.036596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.037037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.037392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.057778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:50.059143 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:50.129909 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1151/2296] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:26:50.142927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:50.144402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:50.202901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349177c0-c6ee-4637-882e-a6b0d9ff72d9 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:50.206451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7e6f3-4e0d-4cdd-a040-beb02f839f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:50.207058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7e6f3-4e0d-4cdd-a040-beb02f839f29 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.207332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7e6f3-4e0d-4cdd-a040-beb02f839f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.207600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7e6f3-4e0d-4cdd-a040-beb02f839f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.214268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:50.217840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7e6f3-4e0d-4cdd-a040-beb02f839f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:50.219295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7e6f3-4e0d-4cdd-a040-beb02f839f29 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:50.228799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1146/2297] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:50.697551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:50.699014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:50.713544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4cf3ae-ccd4-4f88-95e5-0c1909de153e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:50.718448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:50.719102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.719386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.719666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] PATH_INFO: `/v3/projects/43356e73ba6f418a81c4e94e7c76bf15` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.720838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=43356e73ba6f418a81c4e94e7c76bf15)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:50.722987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:50.856777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43356e73ba6f418a81c4e94e7c76bf15', 'request_id': 'req-d5899a00-47ec-4885-90fe-69c30c8f0f4a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.862925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43356e73ba6f418a81c4e94e7c76bf15', 'request_id': 'req-d5899a00-47ec-4885-90fe-69c30c8f0f4a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.869051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43356e73ba6f418a81c4e94e7c76bf15', 'request_id': 'req-d5899a00-47ec-4885-90fe-69c30c8f0f4a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.965390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] The token cache is being invalidate because project 43356e73ba6f418a81c4e94e7c76bf15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:50.965869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.966388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d5899a00-47ec-4885-90fe-69c30c8f0f4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:50.968215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1152/2298] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:50 2022] DELETE /identity/v3/projects/43356e73ba6f418a81c4e94e7c76bf15 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:50.973124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55616d-57f1-4e75-b242-a1f0bec15505 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:50.981329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55616d-57f1-4e75-b242-a1f0bec15505 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:50.981329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f55616d-57f1-4e75-b242-a1f0bec15505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:50.997495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8f55616d-57f1-4e75-b242-a1f0bec15505 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:50.999109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8f55616d-57f1-4e75-b242-a1f0bec15505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:51.070499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1147/2299] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:51.078702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec532b-e535-47cb-84b3-f137f034dd02 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.078991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec532b-e535-47cb-84b3-f137f034dd02 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.079275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec532b-e535-47cb-84b3-f137f034dd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.105702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-71ec532b-e535-47cb-84b3-f137f034dd02 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:51.106956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-71ec532b-e535-47cb-84b3-f137f034dd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:51.115339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1153/2300] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:51.120006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55616d-57f1-4e75-b242-a1f0bec15505 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.130437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f55616d-57f1-4e75-b242-a1f0bec15505 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.137040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.137645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.138095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.138371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.139068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:26:51.139372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.141036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.156596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1148/2301] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:26:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:26:51.158434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec532b-e535-47cb-84b3-f137f034dd02 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.168329 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec532b-e535-47cb-84b3-f137f034dd02 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.172888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.173495 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.173791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.174070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.174727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.176621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.189899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:51.260039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1154/2302] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:26:51 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:51.261367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.271808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6ffbaf-ce71-4699-8c8e-2230b675e247 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.328822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.329443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.329724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.330033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.330741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.332629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.444375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1149/2303] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:26:51 2022] POST /identity/v3/users => generated 287 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:26:51.448525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.459120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79516a08-89e0-49c7-a8be-d2673653bbf8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.464605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.465216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.465493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.465791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.466487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.468080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.478028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1155/2304] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:51.482358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.492323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2abc14-9a0b-4ee1-9f4a-5fc493e65006 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.497524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a270193-500f-4226-8bf6-4eb1bb130a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.503049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270193-500f-4226-8bf6-4eb1bb130a30 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.503049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270193-500f-4226-8bf6-4eb1bb130a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.503049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a270193-500f-4226-8bf6-4eb1bb130a30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.503049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a270193-500f-4226-8bf6-4eb1bb130a30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.503049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a270193-500f-4226-8bf6-4eb1bb130a30 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.511950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1150/2305] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:26:51.515946 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.525907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bd818-7341-4035-b635-f9859db7a42f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.530626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.531275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.531559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.531838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] PATH_INFO: `/v3/projects/46a8f3cc20ad4b6faae6a20a9cfba1ad/users/9bbd22dc373843ce8c88b3e33e59c30a/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.546976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46a8f3cc20ad4b6faae6a20a9cfba1ad, user_id=9bbd22dc373843ce8c88b3e33e59c30a, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.549630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.701024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1156/2306] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:26:51 2022] PUT /identity/v3/projects/46a8f3cc20ad4b6faae6a20a9cfba1ad/users/9bbd22dc373843ce8c88b3e33e59c30a/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:51.711361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8dbf-c935-473b-8e3a-8c3a0c773f13 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.711643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8dbf-c935-473b-8e3a-8c3a0c773f13 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.711914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf8dbf-c935-473b-8e3a-8c3a0c773f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.739832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d3bf8dbf-c935-473b-8e3a-8c3a0c773f13 None None] MFA Rules not processed for user `9bbd22dc373843ce8c88b3e33e59c30a`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:51.741161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d3bf8dbf-c935-473b-8e3a-8c3a0c773f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:51.803502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:51.825716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1151/2307] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:51.841953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:51.844378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:51.902105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ecd09-94d1-4145-ba49-0fba81b5dfd1 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:51.906457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cc383f-e4ab-4160-85df-4e8049726d34 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:51.907323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc383f-e4ab-4160-85df-4e8049726d34 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:51.907702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc383f-e4ab-4160-85df-4e8049726d34 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:51.908077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cc383f-e4ab-4160-85df-4e8049726d34 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:51.920045 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc383f-e4ab-4160-85df-4e8049726d34 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:51.921799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cc383f-e4ab-4160-85df-4e8049726d34 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:51.933433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1157/2308] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:51 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:26:51.962914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8dbf-c935-473b-8e3a-8c3a0c773f13 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:52.048314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf8dbf-c935-473b-8e3a-8c3a0c773f13 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:52.053520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:52.054459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:52.054778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:52.055065 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] PATH_INFO: `/v3/users/9bbd22dc373843ce8c88b3e33e59c30a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:52.056490 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bbd22dc373843ce8c88b3e33e59c30a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:52.058740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:52.293174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bbd22dc373843ce8c88b3e33e59c30a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:52.433115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bbd22dc373843ce8c88b3e33e59c30a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:52.442233 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bbd22dc373843ce8c88b3e33e59c30a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:52.455466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bbd22dc373843ce8c88b3e33e59c30a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:52.456281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bbd22dc373843ce8c88b3e33e59c30a'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:52.462510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1152/2309] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:51 2022] DELETE /identity/v3/users/9bbd22dc373843ce8c88b3e33e59c30a => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:26:52.467739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb1c3-923e-477f-baf6-c8ba7d9570a1 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:52.468269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb1c3-923e-477f-baf6-c8ba7d9570a1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:52.468536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bb1c3-923e-477f-baf6-c8ba7d9570a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:52.487230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-491bb1c3-923e-477f-baf6-c8ba7d9570a1 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:52.488414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-491bb1c3-923e-477f-baf6-c8ba7d9570a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:52.558212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1158/2310] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:52.566620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:52.568080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:52.642752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca441bcb-a44c-4591-a080-da1ddab83c5f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:52.646637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:52.647368 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:52.647754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:52.648232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:52.658238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:52.660213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:52.685916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1153/2311] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:26:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:26:52.970834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:52.972112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:52.972672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.008044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:53.010671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:53.101838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1159/2312] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:26:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:53.126276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:53.129489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:53.157906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:53.239486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c0227f-4393-45ac-939f-d9ba4f471c54 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:53.245478 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c2f27-019d-4584-ab9c-3b828a625143 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:53.246181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2f27-019d-4584-ab9c-3b828a625143 service swift] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.246427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2f27-019d-4584-ab9c-3b828a625143 service swift] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.246822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c2f27-019d-4584-ab9c-3b828a625143 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.256619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2f27-019d-4584-ab9c-3b828a625143 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:53.259212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c2f27-019d-4584-ab9c-3b828a625143 service swift] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:53.273033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:53.278048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:53.296396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1154/2313] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:26:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:26:53.311745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:26:53.327436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fabd2-4b5d-4a81-9b40-e0838f4ebb4c None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:53.339598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:53.340345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:53.340697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:53.341050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] PATH_INFO: `/v3/projects/46a8f3cc20ad4b6faae6a20a9cfba1ad` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:53.342528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46a8f3cc20ad4b6faae6a20a9cfba1ad)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:53.344918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:26:53.536571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46a8f3cc20ad4b6faae6a20a9cfba1ad', 'request_id': 'req-dc82f18f-fdfb-4494-91e4-7035d80af490'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:53.543129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46a8f3cc20ad4b6faae6a20a9cfba1ad', 'request_id': 'req-dc82f18f-fdfb-4494-91e4-7035d80af490'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:53.552464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46a8f3cc20ad4b6faae6a20a9cfba1ad', 'request_id': 'req-dc82f18f-fdfb-4494-91e4-7035d80af490'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:53.713678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] The token cache is being invalidate because project 46a8f3cc20ad4b6faae6a20a9cfba1ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:26:53.714060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:53.718476 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:26:53.720458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1160/2314] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:26:53 2022] DELETE /identity/v3/projects/46a8f3cc20ad4b6faae6a20a9cfba1ad => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:26:57.944582 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4cb4a-4193-4ec8-a178-d4d540a43cff None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:57.945276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4cb4a-4193-4ec8-a178-d4d540a43cff None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:57.945566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c4cb4a-4193-4ec8-a178-d4d540a43cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:58.013660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b6c4cb4a-4193-4ec8-a178-d4d540a43cff None None] MFA Rules not processed for user `0104b0fa57ac4ea280ffd3fc540e6358`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:26:58.022083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b6c4cb4a-4193-4ec8-a178-d4d540a43cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:58.240259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1155/2315] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:26:57 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:26:59.539930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:26:59.542156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:26:59.753677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82f18f-fdfb-4494-91e4-7035d80af490 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:26:59.770593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:26:59.772877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:26:59.775841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:26:59.776145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] PATH_INFO: `/v3/users/d6819f3ee07842dbbbc20470a8909c71` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:26:59.782169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6819f3ee07842dbbbc20470a8909c71)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:26:59.786659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:00.136674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6819f3ee07842dbbbc20470a8909c71'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:00.140584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6819f3ee07842dbbbc20470a8909c71'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:00.196929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6819f3ee07842dbbbc20470a8909c71'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:00.198747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6819f3ee07842dbbbc20470a8909c71'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:00.334959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6819f3ee07842dbbbc20470a8909c71'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:00.366725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1161/2316] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:26:59 2022] DELETE /identity/v3/users/d6819f3ee07842dbbbc20470a8909c71 => generated 0 bytes in 827 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:00.371403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:00.375738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:00.375738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:00.444804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:00.450463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:00.808603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:00.811433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:00.827742 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1156/2317] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:00.847327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:00.967613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab01882-e265-4a00-a9af-ac8a56989094 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:00.971944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9f62-824a-46a4-87a7-3b30fa958dbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:00.972703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9f62-824a-46a4-87a7-3b30fa958dbc service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:00.973161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9f62-824a-46a4-87a7-3b30fa958dbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:00.973536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9f62-824a-46a4-87a7-3b30fa958dbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:00.984891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9f62-824a-46a4-87a7-3b30fa958dbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:00.987153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9f62-824a-46a4-87a7-3b30fa958dbc service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:01.027450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1162/2318] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:01.855795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:01.857499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:01.880995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47f300c-e880-4527-95e3-a7f1887e8d39 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:01.920244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:01.921530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:01.922022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:01.922482 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] PATH_INFO: `/v3/projects/8df43b7e27da486b8cc1c729de7dd3b8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:01.924295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8df43b7e27da486b8cc1c729de7dd3b8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:01.928511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:02.122559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:02.163271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8df43b7e27da486b8cc1c729de7dd3b8', 'request_id': 'req-deba28d5-d4af-41ae-bf94-fd53f1644673'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:02.307303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8df43b7e27da486b8cc1c729de7dd3b8', 'request_id': 'req-deba28d5-d4af-41ae-bf94-fd53f1644673'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:02.314653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8df43b7e27da486b8cc1c729de7dd3b8', 'request_id': 'req-deba28d5-d4af-41ae-bf94-fd53f1644673'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:02.380585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] The token cache is being invalidate because project 8df43b7e27da486b8cc1c729de7dd3b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:27:02.380888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:02.386427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-deba28d5-d4af-41ae-bf94-fd53f1644673 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:02.393066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1157/2319] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:27:01 2022] DELETE /identity/v3/projects/8df43b7e27da486b8cc1c729de7dd3b8 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:02.394703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba32d-147e-4ca7-b50f-bb16f47d7a4f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:02.395758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba32d-147e-4ca7-b50f-bb16f47d7a4f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:02.396053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba32d-147e-4ca7-b50f-bb16f47d7a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:02.448967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4f9ba32d-147e-4ca7-b50f-bb16f47d7a4f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:02.450245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4f9ba32d-147e-4ca7-b50f-bb16f47d7a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:02.570322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1163/2320] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:02.571363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a821a09-dc3a-4b8b-9a26-1eb2e2a4c306 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:02.572236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a821a09-dc3a-4b8b-9a26-1eb2e2a4c306 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:02.572518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a821a09-dc3a-4b8b-9a26-1eb2e2a4c306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:02.600475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-2a821a09-dc3a-4b8b-9a26-1eb2e2a4c306 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:02.601918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2a821a09-dc3a-4b8b-9a26-1eb2e2a4c306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:02.621000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1158/2321] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:02.624414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba32d-147e-4ca7-b50f-bb16f47d7a4f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:02.642626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba32d-147e-4ca7-b50f-bb16f47d7a4f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:02.669986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:02.669986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:02.669986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:02.669986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:02.671209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:02.671209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:02.672586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:02.691959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1164/2322] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:02.698073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a821a09-dc3a-4b8b-9a26-1eb2e2a4c306 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:02.712316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a821a09-dc3a-4b8b-9a26-1eb2e2a4c306 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:02.717996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:02.718851 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:02.719122 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:02.719415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:02.720056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:02.721993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:02.939442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1159/2323] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:27:02 2022] POST /identity/v3/projects => generated 371 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:27:02.944210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:02.956546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808ae80-d6cc-4e66-b30c-0b59bccf9605 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:03.082107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:03.083218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:03.083882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:03.084351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:03.085485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:03.089543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:03.183990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1165/2324] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:27:02 2022] POST /identity/v3/users => generated 286 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:27:03.186769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:03.206509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46df203e-99d9-418b-b3ab-5f67e308e006 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:03.212216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:03.213688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:03.214468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:03.214935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:03.215793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:03.218073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:03.230590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1160/2325] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:27:03.234735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:03.263131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaeb9e2-8e3f-43d1-b6d4-1036a4376ce6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:03.284841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90259e2f-1543-449c-9f65-2228ac4779bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:03.285747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90259e2f-1543-449c-9f65-2228ac4779bc admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:03.286275 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90259e2f-1543-449c-9f65-2228ac4779bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:03.286702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90259e2f-1543-449c-9f65-2228ac4779bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:03.287621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90259e2f-1543-449c-9f65-2228ac4779bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:03.289462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90259e2f-1543-449c-9f65-2228ac4779bc admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:03.307538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1166/2326] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:27:03 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:27:03.312780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:03.336094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4d690-337b-4bb8-87ab-2eace9bef90f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:03.358169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:03.360493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:03.360786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:03.361071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] PATH_INFO: `/v3/projects/57e40b52248c4b86bbfa379fbe10f981/users/5b268b76465541e19c89ed00294c9120/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:03.396382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57e40b52248c4b86bbfa379fbe10f981, user_id=5b268b76465541e19c89ed00294c9120, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:03.404541 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:03.508756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1161/2327] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:27:03 2022] PUT /identity/v3/projects/57e40b52248c4b86bbfa379fbe10f981/users/5b268b76465541e19c89ed00294c9120/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:03.514236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b339-0c1c-43e7-ad5f-4d694b46c005 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:03.515622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b339-0c1c-43e7-ad5f-4d694b46c005 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:03.516596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4781b339-0c1c-43e7-ad5f-4d694b46c005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:03.592156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4781b339-0c1c-43e7-ad5f-4d694b46c005 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:03.593739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4781b339-0c1c-43e7-ad5f-4d694b46c005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:03.607606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:03.708571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1167/2328] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:03.761597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:03.763815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:03.944947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a89ad-01ef-4ec1-b96d-500e1a9237f8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:03.952645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:03.953539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:03.954164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:03.954581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:03.982683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:03.984750 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:04.005948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1162/2329] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:08.396374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2267-80c6-4db3-91c7-cd4a727578a6 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:08.397450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2267-80c6-4db3-91c7-cd4a727578a6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:08.397915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf2267-80c6-4db3-91c7-cd4a727578a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:08.454521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-debf2267-80c6-4db3-91c7-cd4a727578a6 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:08.456997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-debf2267-80c6-4db3-91c7-cd4a727578a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:08.549604 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1168/2330] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 18:27:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:27:08.575044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:08.577146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:08.750936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc8f28c-bb81-4bbc-a223-63481976b8f1 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:08.758941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41695363-9a03-4cb2-ad30-826b342b9727 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:08.760152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41695363-9a03-4cb2-ad30-826b342b9727 service swift] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:08.760536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41695363-9a03-4cb2-ad30-826b342b9727 service swift] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:08.760984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41695363-9a03-4cb2-ad30-826b342b9727 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:08.796458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41695363-9a03-4cb2-ad30-826b342b9727 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:08.798354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41695363-9a03-4cb2-ad30-826b342b9727 service swift] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:08.816050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:08.833745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1163/2331] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:27:12.795270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a009e7-0da7-4225-89ad-7a994d182dae None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:12.796419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a009e7-0da7-4225-89ad-7a994d182dae None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:12.796891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a009e7-0da7-4225-89ad-7a994d182dae None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:12.798545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1169/2332] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:27:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 27 18:27:12.832308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:12.832914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:12.832914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:12.855988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] MFA Rules not processed for user `8bd7c735f47f4810a8a6e3e52adbb756`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:12.857567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:12.939290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1164/2333] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:27:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:13.069577 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a009e7-0da7-4225-89ad-7a994d182dae None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:13.071510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-65a009e7-0da7-4225-89ad-7a994d182dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:13.091822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a009e7-0da7-4225-89ad-7a994d182dae None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:13.103409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:13.104369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:13.107083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:13.107440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:13.117615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:13.122377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:13.130410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1170/2334] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:13 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:13.170406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:13.172296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:13.186741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a89884-5138-4d75-8a12-7854eb7bcc97 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:13.191389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:13.191976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:13.192259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:13.192536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] PATH_INFO: `/v3/users/7eaf1befe60e4038a4247d1c0cce2ffb` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:13.193815 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eaf1befe60e4038a4247d1c0cce2ffb)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:13.196243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:13.411180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eaf1befe60e4038a4247d1c0cce2ffb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:13.551682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eaf1befe60e4038a4247d1c0cce2ffb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:13.564528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eaf1befe60e4038a4247d1c0cce2ffb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:13.603974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eaf1befe60e4038a4247d1c0cce2ffb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:13.604743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-5a56c38e-37b0-4038-8cf8-90d965610fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eaf1befe60e4038a4247d1c0cce2ffb'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:13.622044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1165/2335] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:27:13 2022] DELETE /identity/v3/users/7eaf1befe60e4038a4247d1c0cce2ffb => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:13.929237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:13.945876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93596a9-e2ae-4811-9228-750b58689b93 service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.027967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.028514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.028798 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.029067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] PATH_INFO: `/v3/projects/46c8382cbd794f248d5e6b71ebf02ee9` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.030443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46c8382cbd794f248d5e6b71ebf02ee9)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.032403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.179956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46c8382cbd794f248d5e6b71ebf02ee9', 'request_id': 'req-6a9afa99-0790-441e-95e6-f8363f146275'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:14.182012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:14.187628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46c8382cbd794f248d5e6b71ebf02ee9', 'request_id': 'req-6a9afa99-0790-441e-95e6-f8363f146275'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:14.195621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46c8382cbd794f248d5e6b71ebf02ee9', 'request_id': 'req-6a9afa99-0790-441e-95e6-f8363f146275'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:14.271957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] The token cache is being invalidate because project 46c8382cbd794f248d5e6b71ebf02ee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:27:14.272573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:14.273621 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-6a9afa99-0790-441e-95e6-f8363f146275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:27:14.284016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1171/2336] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:27:13 2022] DELETE /identity/v3/projects/46c8382cbd794f248d5e6b71ebf02ee9 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:14.290610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68fcbb-48e9-4bb2-be29-8c59e8909a75 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.291533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68fcbb-48e9-4bb2-be29-8c59e8909a75 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.292081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c68fcbb-48e9-4bb2-be29-8c59e8909a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.312099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6c68fcbb-48e9-4bb2-be29-8c59e8909a75 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:14.313311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6c68fcbb-48e9-4bb2-be29-8c59e8909a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:14.379667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1166/2337] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:14.396000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0c27e-ac73-4568-94c2-cd377aaae931 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.396302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0c27e-ac73-4568-94c2-cd377aaae931 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.396570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d0c27e-ac73-4568-94c2-cd377aaae931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.417685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-46d0c27e-ac73-4568-94c2-cd377aaae931 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:14.419050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-46d0c27e-ac73-4568-94c2-cd377aaae931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:14.427438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1172/2338] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:14.431868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68fcbb-48e9-4bb2-be29-8c59e8909a75 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:14.442358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c68fcbb-48e9-4bb2-be29-8c59e8909a75 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.446907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.447514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.450998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.450998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.450998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:27:14.450998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.450998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.452254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:14.463587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1167/2339] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:27:14.468420 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0c27e-ac73-4568-94c2-cd377aaae931 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:14.479394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d0c27e-ac73-4568-94c2-cd377aaae931 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.484576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.485434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.485712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.486010 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.486708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.488677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.634833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1173/2340] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:27:14 2022] POST /identity/v3/projects => generated 365 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:27:14.639365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:14.655448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc23e533-b61b-478e-9ee9-8a35878cef75 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.793846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.796362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.796704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.797159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.800094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.804546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.916157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1168/2341] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:27:14 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:27:14.919159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:14.933576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812bbf8-8e42-43f0-aa15-4ffac663d7e2 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:14.948190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:14.948843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:14.949223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:14.949523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:14.950100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:14.957436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:14.987960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1174/2342] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:27:14.988199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:15.000436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738025a-b03d-4443-89e1-a2c0e13896cd admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:15.009578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792cc1e7-8065-40f3-b96f-3288de0ca729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:15.010556 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cc1e7-8065-40f3-b96f-3288de0ca729 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:15.011187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cc1e7-8065-40f3-b96f-3288de0ca729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:15.011648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792cc1e7-8065-40f3-b96f-3288de0ca729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:15.012702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cc1e7-8065-40f3-b96f-3288de0ca729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:15.014621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792cc1e7-8065-40f3-b96f-3288de0ca729 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:15.028407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1169/2343] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:27:14 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:27:15.032763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:15.057448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf39b-61ae-4173-83a8-69cfe5497a7d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:15.077987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:15.077987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:15.077987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:15.077987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] PATH_INFO: `/v3/projects/41191c63c79243c1ba657e29033a4572/users/fdcb55904b364c50ba75de2d6631ed7c/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:15.092866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41191c63c79243c1ba657e29033a4572, user_id=fdcb55904b364c50ba75de2d6631ed7c, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:15.095897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:15.170717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1175/2344] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:27:15 2022] PUT /identity/v3/projects/41191c63c79243c1ba657e29033a4572/users/fdcb55904b364c50ba75de2d6631ed7c/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:15.182412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65289ae5-dab9-4416-a357-00bfa4d14746 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:15.182703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65289ae5-dab9-4416-a357-00bfa4d14746 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:15.182981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65289ae5-dab9-4416-a357-00bfa4d14746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:15.213722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-65289ae5-dab9-4416-a357-00bfa4d14746 None None] MFA Rules not processed for user `fdcb55904b364c50ba75de2d6631ed7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:15.214949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-65289ae5-dab9-4416-a357-00bfa4d14746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:15.308207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1170/2345] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:15.320774 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:15.322844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:15.450611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7504b-c3e3-4107-8d35-1c9f0b9e80b7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:15.454970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:15.455784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:15.459905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:15.459905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:15.473422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:15.475103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:15.489555 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1176/2346] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:15 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:15.764392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ef82-56b2-458f-accd-594b00ae0308 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:15.764903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ef82-56b2-458f-accd-594b00ae0308 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:15.765248 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8ef82-56b2-458f-accd-594b00ae0308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:15.805537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-02c8ef82-56b2-458f-accd-594b00ae0308 None None] MFA Rules not processed for user `5b268b76465541e19c89ed00294c9120`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:15.806874 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-02c8ef82-56b2-458f-accd-594b00ae0308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:15.864461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:15.886479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1171/2347] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:15.890995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:15.892401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:15.964305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b998c59-e4af-4f3e-9edf-43fa36ecaae1 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:15.969132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:15.969893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:15.973672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:15.973672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:15.973672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:15.973672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:16.076249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1177/2348] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:27:15 2022] POST /identity/v3/projects => generated 371 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:27:16.077551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ef82-56b2-458f-accd-594b00ae0308 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.091537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8ef82-56b2-458f-accd-594b00ae0308 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:16.176184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:16.176823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.177104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.177380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.178095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:16.180560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:16.294460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1172/2349] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:27:16 2022] POST /identity/v3/users => generated 292 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:27:16.299571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.305154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:16.310511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a329bc21-a46c-4253-a700-ae2cc0470816 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:16.315109 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:16.315664 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.315941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.316240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.316921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:16.318552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:16.330221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1178/2350] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:27:16.334673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.345312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320d7e5-0234-4714-894f-e97a659f1c4c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:16.352947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:16.353788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.354274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.354810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] PATH_INFO: `/v3/projects/7c9e7632a5e64bc7bb8f8a63472c4c7d/users/37d40726536f4cc49d43643476b06493/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.373130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9e7632a5e64bc7bb8f8a63472c4c7d, user_id=37d40726536f4cc49d43643476b06493, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:16.376845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:16.478865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1173/2351] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:27:16 2022] PUT /identity/v3/projects/7c9e7632a5e64bc7bb8f8a63472c4c7d/users/37d40726536f4cc49d43643476b06493/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:16.484081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.496125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a8fe9-be69-4198-a3b1-3d1de6e12102 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:16.555164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84181048-f7bc-4ee9-8d8e-2a125e382ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:16.555833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181048-f7bc-4ee9-8d8e-2a125e382ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.556113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181048-f7bc-4ee9-8d8e-2a125e382ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.556390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84181048-f7bc-4ee9-8d8e-2a125e382ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.557111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84181048-f7bc-4ee9-8d8e-2a125e382ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:16.558756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84181048-f7bc-4ee9-8d8e-2a125e382ba2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:16.569216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1179/2352] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:27:16.573382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:16.584691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef67af-eb10-467f-9bd0-8040c96c1fa5 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:16.590085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f9cdce-664f-40e5-82d4-bc8f1fc49624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:16.590804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9cdce-664f-40e5-82d4-bc8f1fc49624 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:16.591080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9cdce-664f-40e5-82d4-bc8f1fc49624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:16.591387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f9cdce-664f-40e5-82d4-bc8f1fc49624 admin admin] PATH_INFO: `/v3/projects/7c9e7632a5e64bc7bb8f8a63472c4c7d/users/37d40726536f4cc49d43643476b06493/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:16.593367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9cdce-664f-40e5-82d4-bc8f1fc49624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c9e7632a5e64bc7bb8f8a63472c4c7d, user_id=37d40726536f4cc49d43643476b06493, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:16.596050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f9cdce-664f-40e5-82d4-bc8f1fc49624 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:16.607985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1174/2353] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:27:16 2022] PUT /identity/v3/projects/7c9e7632a5e64bc7bb8f8a63472c4c7d/users/37d40726536f4cc49d43643476b06493/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:27:18.125873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62e2b-9a0f-44af-a18a-8da4f8054b5e None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:18.126380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62e2b-9a0f-44af-a18a-8da4f8054b5e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:18.126463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba62e2b-9a0f-44af-a18a-8da4f8054b5e None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:18.127807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1180/2354] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:18.135919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c232bd-052a-4e7f-bcb0-957c9b626721 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:18.136825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c232bd-052a-4e7f-bcb0-957c9b626721 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:18.137840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c232bd-052a-4e7f-bcb0-957c9b626721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:18.176468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e5c232bd-052a-4e7f-bcb0-957c9b626721 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:18.179108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e5c232bd-052a-4e7f-bcb0-957c9b626721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:18.345287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1175/2355] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:27:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:18.359865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba62e2b-9a0f-44af-a18a-8da4f8054b5e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:18.361734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4ba62e2b-9a0f-44af-a18a-8da4f8054b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:18.484113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba62e2b-9a0f-44af-a18a-8da4f8054b5e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:18.490179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56394288-c69e-4347-b325-09ed2d138a44 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:18.493217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56394288-c69e-4347-b325-09ed2d138a44 service glance] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:18.494282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56394288-c69e-4347-b325-09ed2d138a44 service glance] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:18.494791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56394288-c69e-4347-b325-09ed2d138a44 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:18.515836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56394288-c69e-4347-b325-09ed2d138a44 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:18.517686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56394288-c69e-4347-b325-09ed2d138a44 service glance] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:18.543603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1181/2356] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:18.777298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e82c-0580-4516-a1c9-f1d4e1fe44b1 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:18.777860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e82c-0580-4516-a1c9-f1d4e1fe44b1 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:18.778229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44e82c-0580-4516-a1c9-f1d4e1fe44b1 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:18.779919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1176/2357] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:18.786099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6fd4-2a3a-457b-8e4f-920af866fa9e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:18.786986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6fd4-2a3a-457b-8e4f-920af866fa9e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:18.787430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372f6fd4-2a3a-457b-8e4f-920af866fa9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:18.816544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-372f6fd4-2a3a-457b-8e4f-920af866fa9e None None] MFA Rules not processed for user `052da4ed2e054c70ba8b0bf9b6c5656a`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:18.818906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-372f6fd4-2a3a-457b-8e4f-920af866fa9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:18.894541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1182/2358] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:27:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:18.910782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44e82c-0580-4516-a1c9-f1d4e1fe44b1 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:18.912513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4e44e82c-0580-4516-a1c9-f1d4e1fe44b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:18.930346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44e82c-0580-4516-a1c9-f1d4e1fe44b1 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:18.936645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe7185-3d7e-4e16-912d-d6fe7c7bab72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:18.936645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7185-3d7e-4e16-912d-d6fe7c7bab72 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:18.936645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7185-3d7e-4e16-912d-d6fe7c7bab72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:18.936645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe7185-3d7e-4e16-912d-d6fe7c7bab72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:18.945669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe7185-3d7e-4e16-912d-d6fe7c7bab72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:18.949198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe7185-3d7e-4e16-912d-d6fe7c7bab72 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:18.977328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1177/2359] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:18 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:19.159585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323442b3-8ab3-465c-8b72-e969be24bd01 None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:19.160136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323442b3-8ab3-465c-8b72-e969be24bd01 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:19.160136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323442b3-8ab3-465c-8b72-e969be24bd01 None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:19.161599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1183/2360] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:27:19.168684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeeb11-9a11-4338-9e58-b6fb77c0da8c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:19.169171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeeb11-9a11-4338-9e58-b6fb77c0da8c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:19.169277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eeeb11-9a11-4338-9e58-b6fb77c0da8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:19.196027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-07eeeb11-9a11-4338-9e58-b6fb77c0da8c None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:19.198762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-07eeeb11-9a11-4338-9e58-b6fb77c0da8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:19.220128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1178/2361] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:27:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:27:19.243007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323442b3-8ab3-465c-8b72-e969be24bd01 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:19.260727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323442b3-8ab3-465c-8b72-e969be24bd01 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:19.268046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:19.268864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:19.269323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:19.269750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:19.286686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:19.292695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:19.320006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1184/2362] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:23.735864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ac8e-c8cf-4f95-8d20-a3744433213e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:23.736424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ac8e-c8cf-4f95-8d20-a3744433213e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:23.736535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9ac8e-c8cf-4f95-8d20-a3744433213e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:23.776452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-26f9ac8e-c8cf-4f95-8d20-a3744433213e None None] MFA Rules not processed for user `37d40726536f4cc49d43643476b06493`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:23.777817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-26f9ac8e-c8cf-4f95-8d20-a3744433213e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:23.782738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:23.859672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1179/2363] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:23.874078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:23.875507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:23.893964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a239e3-2c31-48cd-a755-4ea9ddaef4ab service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:23.903662 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:23.904324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:23.904605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:23.904902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:23.934172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:23.965477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:23.967209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:23.977182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1185/2364] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:27.380191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90b417-719c-442f-abd7-1f24030154b2 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:27.380734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90b417-719c-442f-abd7-1f24030154b2 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:27.381061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c90b417-719c-442f-abd7-1f24030154b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:27.404827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-0c90b417-719c-442f-abd7-1f24030154b2 None None] MFA Rules not processed for user `5b268b76465541e19c89ed00294c9120`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:27.407967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0c90b417-719c-442f-abd7-1f24030154b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:27.418120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1180/2365] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:27:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:30.287194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:30.289249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:30.369745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372379c7-0621-43cf-8430-48f16972b319 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:30.376054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:30.376705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:30.376982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:30.377290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:30.379068 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:30.391735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:30.393536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:30.405713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1186/2366] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:32.757735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ccbd-1665-4293-9d27-9f97fd5a7d83 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:32.758195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ccbd-1665-4293-9d27-9f97fd5a7d83 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:32.758330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a02ccbd-1665-4293-9d27-9f97fd5a7d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:32.778159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-9a02ccbd-1665-4293-9d27-9f97fd5a7d83 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:32.779331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9a02ccbd-1665-4293-9d27-9f97fd5a7d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:32.836565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1181/2367] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:27:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:32.848535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:32.850003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:32.933374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0674505-2f2f-43f4-a5a0-62330c00a195 service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:32.938863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199dcf9-6eb6-456a-ae2f-a1a2ef9ac491 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:32.939744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199dcf9-6eb6-456a-ae2f-a1a2ef9ac491 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:32.940240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199dcf9-6eb6-456a-ae2f-a1a2ef9ac491 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:32.940562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199dcf9-6eb6-456a-ae2f-a1a2ef9ac491 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:32.950400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199dcf9-6eb6-456a-ae2f-a1a2ef9ac491 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:32.952155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199dcf9-6eb6-456a-ae2f-a1a2ef9ac491 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:32.962656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1187/2368] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:27:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:27:42.829328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=55 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:42.958593 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=80 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:45.681668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ccbd-1665-4293-9d27-9f97fd5a7d83 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:45.691390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a02ccbd-1665-4293-9d27-9f97fd5a7d83 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:45.695550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:45.696203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:45.696480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:45.696754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:45.698499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:45.763709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:45.765054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:45.774833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1182/2369] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:27:55.770215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=30 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:27:57.173000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9253d-c7b6-459f-8d01-e3a7fa5f0511 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:57.173539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9253d-c7b6-459f-8d01-e3a7fa5f0511 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:57.174102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9253d-c7b6-459f-8d01-e3a7fa5f0511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:57.212388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-32a9253d-c7b6-459f-8d01-e3a7fa5f0511 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:27:57.216227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-32a9253d-c7b6-459f-8d01-e3a7fa5f0511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:27:57.235046 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1188/2370] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 18:27:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:27:57.264023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:27:57.278140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc0170-4688-4907-a1be-849b15c7b5c9 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:27:57.283629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc27c8dc-bc44-4823-99ee-869fb6ccc441 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:27:57.284674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c8dc-bc44-4823-99ee-869fb6ccc441 service swift] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:27:57.285169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c8dc-bc44-4823-99ee-869fb6ccc441 service swift] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:27:57.285830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc27c8dc-bc44-4823-99ee-869fb6ccc441 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:27:57.295930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c8dc-bc44-4823-99ee-869fb6ccc441 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:27:57.298213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc27c8dc-bc44-4823-99ee-869fb6ccc441 service swift] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:27:57.307314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1183/2371] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:27:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:28:03.001969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9253d-c7b6-459f-8d01-e3a7fa5f0511 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:03.066659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9253d-c7b6-459f-8d01-e3a7fa5f0511 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:03.071194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:03.071832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:03.072116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:03.072391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] PATH_INFO: `/v3/users/fdcb55904b364c50ba75de2d6631ed7c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:03.073571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdcb55904b364c50ba75de2d6631ed7c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:03.075547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:03.322928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdcb55904b364c50ba75de2d6631ed7c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:03.323510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdcb55904b364c50ba75de2d6631ed7c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:03.335456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdcb55904b364c50ba75de2d6631ed7c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:03.336121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdcb55904b364c50ba75de2d6631ed7c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:03.405788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdcb55904b364c50ba75de2d6631ed7c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:03.418541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1189/2372] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:28:03 2022] DELETE /identity/v3/users/fdcb55904b364c50ba75de2d6631ed7c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:28:03.423101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:03.423653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:03.423653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:03.441981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:03.443169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:03.501296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1184/2373] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:28:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:28:03.511844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:03.513270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:03.577820 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e5c96-7d98-4c97-a17d-5909c8364043 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:03.581993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:03.582653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:03.582931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:03.583202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:03.593612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:03.595074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:03.604999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1190/2374] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:28:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:28:04.089587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:04.089587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:04.120856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5268d665-a83e-41ac-96ed-ba951543db7c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:04.130271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:04.131006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:04.131419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:04.131828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] PATH_INFO: `/v3/projects/41191c63c79243c1ba657e29033a4572` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:04.133394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] RBAC: Authorizing `identity:delete_project(project_id=41191c63c79243c1ba657e29033a4572)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:04.135607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:04.264071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41191c63c79243c1ba657e29033a4572', 'request_id': 'req-59ac9a58-d97f-4582-9040-a14ea421746f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:04.372631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41191c63c79243c1ba657e29033a4572', 'request_id': 'req-59ac9a58-d97f-4582-9040-a14ea421746f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:04.378790 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41191c63c79243c1ba657e29033a4572', 'request_id': 'req-59ac9a58-d97f-4582-9040-a14ea421746f'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:04.390654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] The token cache is being invalidate because project 41191c63c79243c1ba657e29033a4572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:28:04.390946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:04.391603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-59ac9a58-d97f-4582-9040-a14ea421746f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:28:04.393140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1185/2375] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:28:04 2022] DELETE /identity/v3/projects/41191c63c79243c1ba657e29033a4572 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:28:11.942407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:28:11.952061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14ec47c-5f3d-410d-9868-9ac36118a0a3 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:28:11.965285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:12.002034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b77bbb-e94b-4642-ab17-04d6c7a26930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:28:12.002645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77bbb-e94b-4642-ab17-04d6c7a26930 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:12.002921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77bbb-e94b-4642-ab17-04d6c7a26930 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:12.003191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b77bbb-e94b-4642-ab17-04d6c7a26930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:12.004994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a9b77bbb-e94b-4642-ab17-04d6c7a26930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:12.065793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b77bbb-e94b-4642-ab17-04d6c7a26930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:28:12.067223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b77bbb-e94b-4642-ab17-04d6c7a26930 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:28:12.083315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1191/2376] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:28:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:28:12.332598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a2a59-24b4-4081-963d-326137dacfba None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:12.333379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a2a59-24b4-4081-963d-326137dacfba None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:12.333379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a2a59-24b4-4081-963d-326137dacfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:12.352877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e31a2a59-24b4-4081-963d-326137dacfba None None] MFA Rules not processed for user `c25ffc3341b34fae80a7842c0b0fdbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:12.354103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e31a2a59-24b4-4081-963d-326137dacfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:12.406693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1186/2377] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:28:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:28:22.400125 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=85,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:22.508408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=43 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:24.206929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:24.207812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:24.207812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:24.227185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] MFA Rules not processed for user `8bbfd4cdd3ba4066ab933f00433c8164`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:24.228385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:24.283092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1192/2378] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:28:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:28:34.275586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=25 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:28:54.543070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:28:54.543584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:28:54.543690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:28:54.562620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] MFA Rules not processed for user `9297f4c0b9c34321aee707525b2371a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:28:54.563845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:28:54.619528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1187/2379] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:28:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:29:04.612635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=25 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:27.695107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:27.696760 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:27.715083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9c466a-ce91-49f9-a706-bf1ae0e04bd2 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:27.719514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:27.720138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:27.720422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:27.720699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:27.722517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:27.799898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:27.801358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:27.813561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1193/2380] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:29.728526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:29.730060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:29.742168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606627d9-97ed-4551-bccf-96e3379228ed None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:29.745735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55cc48-8bf7-4c0b-878c-5af8919e8a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:29.746388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cc48-8bf7-4c0b-878c-5af8919e8a30 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:29.746676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cc48-8bf7-4c0b-878c-5af8919e8a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:29.746946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55cc48-8bf7-4c0b-878c-5af8919e8a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:29.748663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0e55cc48-8bf7-4c0b-878c-5af8919e8a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:29.761910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55cc48-8bf7-4c0b-878c-5af8919e8a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:29.763367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55cc48-8bf7-4c0b-878c-5af8919e8a30 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:29.774807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1188/2381] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:34.469111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:34.478016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6d8e6-1a79-4d74-8ce0-5b0ce877dac0 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:34.482525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:34.483824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:34.484255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:34.484535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:34.486347 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:34.550849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:34.552253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:34.561881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1194/2382] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:36.782293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246224b8-e943-4bd0-b37b-6183983a26f8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:36.782293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246224b8-e943-4bd0-b37b-6183983a26f8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:36.782293 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246224b8-e943-4bd0-b37b-6183983a26f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:36.792318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-246224b8-e943-4bd0-b37b-6183983a26f8 None None] MFA Rules not processed for user `c25ffc3341b34fae80a7842c0b0fdbd7`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:36.793535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-246224b8-e943-4bd0-b37b-6183983a26f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:36.801580 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1189/2383] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:29:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:29:38.979502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:38.981082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:38.994958 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a5d77-a26c-490e-a068-64e71f8d3426 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:38.999875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:39.000551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:39.000834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:39.001108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] PATH_INFO: `/v3/users/8bbfd4cdd3ba4066ab933f00433c8164` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:39.002367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bbfd4cdd3ba4066ab933f00433c8164)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:39.004320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:39.165782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bbfd4cdd3ba4066ab933f00433c8164'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.166479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bbfd4cdd3ba4066ab933f00433c8164'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.179060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bbfd4cdd3ba4066ab933f00433c8164'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.179708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bbfd4cdd3ba4066ab933f00433c8164'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.273145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-df8fbc3b-fa24-4729-8ca1-8a6880a8593f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bbfd4cdd3ba4066ab933f00433c8164'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.275571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:39.287052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1195/2384] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:29:38 2022] DELETE /identity/v3/users/8bbfd4cdd3ba4066ab933f00433c8164 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:29:39.557603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246224b8-e943-4bd0-b37b-6183983a26f8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:39.569390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246224b8-e943-4bd0-b37b-6183983a26f8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:39.627891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:39.628566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:39.628848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:39.629127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] PATH_INFO: `/v3/projects/2ce893126b194910ba9de063a09a3387` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:39.630332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ce893126b194910ba9de063a09a3387)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:39.632333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:39.776954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ce893126b194910ba9de063a09a3387', 'request_id': 'req-7adf3109-f52c-4610-8ae7-6896a7c51bbe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.870033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ce893126b194910ba9de063a09a3387', 'request_id': 'req-7adf3109-f52c-4610-8ae7-6896a7c51bbe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.878108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ce893126b194910ba9de063a09a3387', 'request_id': 'req-7adf3109-f52c-4610-8ae7-6896a7c51bbe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.890430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] The token cache is being invalidate because project 2ce893126b194910ba9de063a09a3387 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:29:39.890716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.891577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7adf3109-f52c-4610-8ae7-6896a7c51bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:29:39.893866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1190/2385] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:29:39 2022] DELETE /identity/v3/projects/2ce893126b194910ba9de063a09a3387 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:29:39.898758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265c8e-db77-4373-90ca-5df0c23bd237 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:39.899194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265c8e-db77-4373-90ca-5df0c23bd237 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:39.899379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64265c8e-db77-4373-90ca-5df0c23bd237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:39.920544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-64265c8e-db77-4373-90ca-5df0c23bd237 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:39.921749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-64265c8e-db77-4373-90ca-5df0c23bd237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:39.984527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1196/2386] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:29:39.992610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b1c9e-f538-4504-81ae-9670eb651988 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:39.992895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b1c9e-f538-4504-81ae-9670eb651988 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:39.993170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2b1c9e-f538-4504-81ae-9670eb651988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.014089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-ba2b1c9e-f538-4504-81ae-9670eb651988 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:40.016288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ba2b1c9e-f538-4504-81ae-9670eb651988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:40.025604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1191/2387] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:29:40.030088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64265c8e-db77-4373-90ca-5df0c23bd237 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:40.040863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64265c8e-db77-4373-90ca-5df0c23bd237 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:40.045718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:40.046367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.046663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.046925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.047678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:29:40.053367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:40.053367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:40.062303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1197/2388] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:29:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:29:40.066732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b1c9e-f538-4504-81ae-9670eb651988 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:40.076372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2b1c9e-f538-4504-81ae-9670eb651988 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:40.082222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:40.082844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.083243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.083523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.084199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:40.086130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:40.195707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1192/2389] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:29:40 2022] POST /identity/v3/projects => generated 375 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:29:40.200102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:40.210920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d8663-df71-42eb-8249-5c7ccbe90440 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:40.268446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:40.269269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.269428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.269601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.270308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:40.272228 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:40.365298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1198/2390] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:29:40 2022] POST /identity/v3/users => generated 288 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:29:40.366520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:40.377704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa5091e-2bc9-47f3-992a-52105301069c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:40.382512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:40.383121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.383401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.383673 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.384486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:40.386229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:40.396420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1193/2391] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:29:40.400510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:40.410630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04dbf9-77d6-4537-a642-5d15d6566cbd admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:40.415465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd91c085-26d5-4239-98d0-1c7d19ac4690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:40.416076 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c085-26d5-4239-98d0-1c7d19ac4690 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.416382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c085-26d5-4239-98d0-1c7d19ac4690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.416656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91c085-26d5-4239-98d0-1c7d19ac4690 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.417349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91c085-26d5-4239-98d0-1c7d19ac4690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:40.418975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd91c085-26d5-4239-98d0-1c7d19ac4690 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:40.430653 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1199/2392] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:29:40.439130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:40.449055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb916fa7-bb46-41a0-ba28-2fc93e03e54a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:40.453994 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:40.454650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.454928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.455199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] PATH_INFO: `/v3/projects/a1b1f6054abf4d8fbe5e629c86ea29c4/users/e571a6378a0240cfbe40f4cc63e0486d/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.470729 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b1f6054abf4d8fbe5e629c86ea29c4, user_id=e571a6378a0240cfbe40f4cc63e0486d, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:40.473536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:40.576358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1194/2393] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:29:40 2022] PUT /identity/v3/projects/a1b1f6054abf4d8fbe5e629c86ea29c4/users/e571a6378a0240cfbe40f4cc63e0486d/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:29:40.581796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.584710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.584710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.603353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:40.604580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:40.662678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:40.674841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1200/2394] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:29:40.684970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:40.686912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:40.697466 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:40.747454 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58489972-19f6-4243-a2c2-d65e65ede82e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:40.751316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:40.751966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:40.752244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:40.752674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:40.766308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:40.767812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:40.778858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1195/2395] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:44.510627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:44.512158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:44.602161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9591769e-3558-4a2f-a33d-a284f693f61f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:44.609973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4953ed8-b61b-49d2-b411-93aa96eab091 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:44.611268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4953ed8-b61b-49d2-b411-93aa96eab091 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:44.611268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4953ed8-b61b-49d2-b411-93aa96eab091 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:44.611584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4953ed8-b61b-49d2-b411-93aa96eab091 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:44.613972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a4953ed8-b61b-49d2-b411-93aa96eab091 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:44.680359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4953ed8-b61b-49d2-b411-93aa96eab091 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:44.681973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4953ed8-b61b-49d2-b411-93aa96eab091 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:44.691709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1201/2396] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:45.075544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:45.077121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:45.096853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04c24-5b07-4058-909e-1b50cbcfffc2 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:45.110967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:45.110967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:45.110967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:45.110967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:45.113714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:45.186699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:45.189346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:45.200159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1196/2397] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:47.096341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea896e-11e5-448f-998c-ea143652ff21 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:47.096811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea896e-11e5-448f-998c-ea143652ff21 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:47.096910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea896e-11e5-448f-998c-ea143652ff21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:47.137304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9aea896e-11e5-448f-998c-ea143652ff21 None None] MFA Rules not processed for user `e571a6378a0240cfbe40f4cc63e0486d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:47.138461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9aea896e-11e5-448f-998c-ea143652ff21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:47.230962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1202/2398] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:29:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:29:47.239412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:47.255781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305397c2-c7a4-41e8-8dc0-11ccb6ae6695 service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:47.266953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:47.267597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:47.268090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:47.268535 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:47.277629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:47.281594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:47.297677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1197/2399] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:50.371862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:50.371862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:50.371862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:50.390282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] MFA Rules not processed for user `e571a6378a0240cfbe40f4cc63e0486d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:29:50.391832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:50.399486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1203/2400] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:29:50 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:29:50.917379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:50.918846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:50.931440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51756f83-9f92-41fb-905a-fc45432c3062 service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:50.935298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:50.935910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:50.936189 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:50.936462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:50.939117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:50.949079 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:50.950551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:50.960363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1198/2401] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:51.755486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:51.756947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:51.784079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:29:51.846891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5561011d-eb99-4d9c-ad9b-a79a66b2e749 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:51.855217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8140cf-7524-4ff3-b352-62d2753037b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:51.856144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8140cf-7524-4ff3-b352-62d2753037b3 service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:51.856611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8140cf-7524-4ff3-b352-62d2753037b3 service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:51.857037 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8140cf-7524-4ff3-b352-62d2753037b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:51.859193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ca8140cf-7524-4ff3-b352-62d2753037b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:51.872894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8140cf-7524-4ff3-b352-62d2753037b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:51.875812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8140cf-7524-4ff3-b352-62d2753037b3 service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:51.889265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1204/2402] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:29:55.499642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:29:55.508397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a562f8-3085-417e-a46e-7b0a024431f0 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:29:55.512397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6ce7d-d63c-4192-b28b-0ff705db8da6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:29:55.512826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ce7d-d63c-4192-b28b-0ff705db8da6 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:29:55.513104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ce7d-d63c-4192-b28b-0ff705db8da6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:29:55.513378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6ce7d-d63c-4192-b28b-0ff705db8da6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:29:55.515825 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7fa6ce7d-d63c-4192-b28b-0ff705db8da6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:29:55.525872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6ce7d-d63c-4192-b28b-0ff705db8da6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:29:55.527347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6ce7d-d63c-4192-b28b-0ff705db8da6 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:29:55.536081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1199/2403] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:29:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:30:01.883431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=24 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:30:02.293365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b840-0676-470f-8d8c-f147013085bc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:02.293648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b840-0676-470f-8d8c-f147013085bc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:02.293950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3199b840-0676-470f-8d8c-f147013085bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:02.312890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3199b840-0676-470f-8d8c-f147013085bc None None] MFA Rules not processed for user `0104b0fa57ac4ea280ffd3fc540e6358`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:30:02.314115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3199b840-0676-470f-8d8c-f147013085bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:02.369496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1205/2404] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:30:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:30:03.311180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73067d3-d6a4-4cb0-9f35-6556ba096414 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:03.315617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73067d3-d6a4-4cb0-9f35-6556ba096414 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:03.315617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73067d3-d6a4-4cb0-9f35-6556ba096414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:03.333919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d73067d3-d6a4-4cb0-9f35-6556ba096414 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:30:03.335337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d73067d3-d6a4-4cb0-9f35-6556ba096414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:03.404118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1200/2405] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:30:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:30:03.642040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b840-0676-470f-8d8c-f147013085bc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:03.643436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3199b840-0676-470f-8d8c-f147013085bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:03.712189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3199b840-0676-470f-8d8c-f147013085bc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:03.717138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:03.717847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:03.718132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:03.718410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:03.726357 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:03.727930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:03.735986 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1206/2406] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:30:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:30:10.454338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73067d3-d6a4-4cb0-9f35-6556ba096414 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:10.475303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73067d3-d6a4-4cb0-9f35-6556ba096414 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:10.483104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8047aa2-fb00-4371-87fd-c99c32306f4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:10.483975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8047aa2-fb00-4371-87fd-c99c32306f4c service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:10.484465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8047aa2-fb00-4371-87fd-c99c32306f4c service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:10.484953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8047aa2-fb00-4371-87fd-c99c32306f4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:10.487906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d8047aa2-fb00-4371-87fd-c99c32306f4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:10.507225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8047aa2-fb00-4371-87fd-c99c32306f4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:10.508857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8047aa2-fb00-4371-87fd-c99c32306f4c service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:10.515605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:30:10.521382 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1201/2407] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:30:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:30:13.733229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=57 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:30:21.405106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:21.419930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d15f7-dc69-4995-99aa-70678b04c080 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:21.426600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71bcd1a-1909-4ce2-91da-f13313febf05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:21.427213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bcd1a-1909-4ce2-91da-f13313febf05 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:21.427524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bcd1a-1909-4ce2-91da-f13313febf05 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:21.427826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71bcd1a-1909-4ce2-91da-f13313febf05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:21.429665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e71bcd1a-1909-4ce2-91da-f13313febf05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:21.449000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bcd1a-1909-4ce2-91da-f13313febf05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:21.449120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71bcd1a-1909-4ce2-91da-f13313febf05 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:21.460647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1207/2408] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:30:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:30:23.326324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0188-b729-4603-b416-43788bad0e0f None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:23.326857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0188-b729-4603-b416-43788bad0e0f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:23.326974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c0188-b729-4603-b416-43788bad0e0f None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:23.328352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1202/2409] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:30:23.334394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3abddb-76af-4f13-bdba-03dce4989693 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:23.335261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3abddb-76af-4f13-bdba-03dce4989693 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:23.335544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3abddb-76af-4f13-bdba-03dce4989693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:23.358126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7d3abddb-76af-4f13-bdba-03dce4989693 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:30:23.359619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7d3abddb-76af-4f13-bdba-03dce4989693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:23.374691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1208/2410] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:30:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:30:23.389637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c0188-b729-4603-b416-43788bad0e0f None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:23.391399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c82c0188-b729-4603-b416-43788bad0e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:23.479989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82c0188-b729-4603-b416-43788bad0e0f None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:23.483816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42cd2a-1341-41e3-83dd-9078a0549f27 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:23.484474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42cd2a-1341-41e3-83dd-9078a0549f27 service glance] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:23.484855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42cd2a-1341-41e3-83dd-9078a0549f27 service glance] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:23.485144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42cd2a-1341-41e3-83dd-9078a0549f27 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:23.501624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42cd2a-1341-41e3-83dd-9078a0549f27 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:23.506081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42cd2a-1341-41e3-83dd-9078a0549f27 service glance] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:23.550032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1203/2411] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:30:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:30:23.820529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffa2b-ed5a-4675-8936-fe93b68a95de None None] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:23.820882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffa2b-ed5a-4675-8936-fe93b68a95de None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:23.821233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fffa2b-ed5a-4675-8936-fe93b68a95de None None] PATH_INFO: `/` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:23.822667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1209/2412] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:30:23.827669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc41c-0b4d-4f9f-abdf-277e302d3df0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:23.827958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc41c-0b4d-4f9f-abdf-277e302d3df0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:23.828237 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcc41c-0b4d-4f9f-abdf-277e302d3df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:23.849111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-73bcc41c-0b4d-4f9f-abdf-277e302d3df0 None None] MFA Rules not processed for user `052da4ed2e054c70ba8b0bf9b6c5656a`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:30:23.850447 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-73bcc41c-0b4d-4f9f-abdf-277e302d3df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:23.857204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1204/2413] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:30:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:30:23.869499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fffa2b-ed5a-4675-8936-fe93b68a95de None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:23.882529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fffa2b-ed5a-4675-8936-fe93b68a95de None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:23.886674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ec059-74a2-4612-990f-129cd5ee8f79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:23.887460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ec059-74a2-4612-990f-129cd5ee8f79 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:23.887740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ec059-74a2-4612-990f-129cd5ee8f79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:23.888011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ec059-74a2-4612-990f-129cd5ee8f79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:23.896316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ec059-74a2-4612-990f-129cd5ee8f79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:23.897957 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ec059-74a2-4612-990f-129cd5ee8f79 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:23.906102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1210/2414] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:30:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:30:23.995369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bad78-ab40-49d4-8fd6-3ec1731bac16 None None] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:23.995986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bad78-ab40-49d4-8fd6-3ec1731bac16 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:23.996264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438bad78-ab40-49d4-8fd6-3ec1731bac16 None None] PATH_INFO: `/` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:23.997677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1205/2415] 10.222.0.67 () {54 vars in 921 bytes} [Wed Jul 27 18:30:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 27 18:30:24.003427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc20dcb-eeaa-4311-a3ec-746a87cfd2b0 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:24.003717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc20dcb-eeaa-4311-a3ec-746a87cfd2b0 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:24.003994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc20dcb-eeaa-4311-a3ec-746a87cfd2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:24.024576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3cc20dcb-eeaa-4311-a3ec-746a87cfd2b0 None None] MFA Rules not processed for user `4e107a27b86243dcbb160a3960682b2d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:30:24.025815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3cc20dcb-eeaa-4311-a3ec-746a87cfd2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:24.035954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1211/2416] 10.222.0.67 () {58 vars in 1018 bytes} [Wed Jul 27 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:30:24.047239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bad78-ab40-49d4-8fd6-3ec1731bac16 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:24.058246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438bad78-ab40-49d4-8fd6-3ec1731bac16 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:24.061989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:24.062599 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:24.062880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:24.063153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:24.073814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:24.075431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:24.087847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1206/2417] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:30:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:30:27.310219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ccc8-fb75-451e-99f5-76ced990d904 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:27.310679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ccc8-fb75-451e-99f5-76ced990d904 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:27.310802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10ccc8-fb75-451e-99f5-76ced990d904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:27.332367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-1f10ccc8-fb75-451e-99f5-76ced990d904 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:30:27.333833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1f10ccc8-fb75-451e-99f5-76ced990d904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:27.346789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1212/2418] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:30:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:30:27.362544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:27.370951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541820e-dcd5-49c4-a5cf-1fc90ddb7795 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:27.375892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bb58e5-d4e5-48d6-8a25-125ed8a27a87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:27.377067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb58e5-d4e5-48d6-8a25-125ed8a27a87 service swift] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:27.377434 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb58e5-d4e5-48d6-8a25-125ed8a27a87 service swift] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:27.377710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bb58e5-d4e5-48d6-8a25-125ed8a27a87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:27.386345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb58e5-d4e5-48d6-8a25-125ed8a27a87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:27.387933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bb58e5-d4e5-48d6-8a25-125ed8a27a87 service swift] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:27.397165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1207/2419] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:30:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:30:29.640146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10ccc8-fb75-451e-99f5-76ced990d904 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:29.654203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10ccc8-fb75-451e-99f5-76ced990d904 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:29.661130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:29.667539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:29.667969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:29.668609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:29.671305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:29.709605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:29.711566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:29.724816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1213/2420] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:30:29 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:30:37.393699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=41 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:30:39.718618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=27 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:30:45.901497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242043f-ed36-47a7-b0a0-421ff7686f88 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:45.902041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242043f-ed36-47a7-b0a0-421ff7686f88 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:45.902315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242043f-ed36-47a7-b0a0-421ff7686f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:45.978566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7242043f-ed36-47a7-b0a0-421ff7686f88 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:30:45.979934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7242043f-ed36-47a7-b0a0-421ff7686f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:30:46.011887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1208/2421] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:30:46.028950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:30:46.108932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a194bc7-dcaa-4c18-9fd9-41fab9e77b01 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:30:46.115344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:30:46.116063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:30:46.116281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:30:46.116553 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:30:46.125316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:30:46.127207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:30:46.135814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1214/2422] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:30:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:30:56.009720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=20 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:30:56.132077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=20 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:02.436835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242043f-ed36-47a7-b0a0-421ff7686f88 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:02.458651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242043f-ed36-47a7-b0a0-421ff7686f88 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:02.463379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:02.464002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:02.464283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:02.464562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:02.466395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:02.506422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:02.507877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:02.528196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1209/2423] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:06.411964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:06.413465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:06.428716 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45b174d-ebd2-4321-bb74-ad51fff4a734 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:06.433836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:06.434455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:06.434741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:06.435016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:06.436772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:06.448984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:06.450987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:06.461411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1215/2424] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:06.581108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:06.582873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:06.595451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a29762-7d2c-473d-93ef-5602bd2a6b5c service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:06.600653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:06.601287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:06.601565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:06.601866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] PATH_INFO: `/v3/users/c25ffc3341b34fae80a7842c0b0fdbd7` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:06.603031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c25ffc3341b34fae80a7842c0b0fdbd7)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:06.604940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:06.843991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c25ffc3341b34fae80a7842c0b0fdbd7'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:06.940987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c25ffc3341b34fae80a7842c0b0fdbd7'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:06.948788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c25ffc3341b34fae80a7842c0b0fdbd7'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:06.961134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c25ffc3341b34fae80a7842c0b0fdbd7'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:06.961802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-0b889d90-ce66-4b36-8a0f-38c3f723fc3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c25ffc3341b34fae80a7842c0b0fdbd7'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:06.967675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1210/2425] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:06 2022] DELETE /identity/v3/users/c25ffc3341b34fae80a7842c0b0fdbd7 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:07.227660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:07.241983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f018d-3959-4b16-8b94-985d76805047 service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:07.302962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:07.303598 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:07.303876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:07.304148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] PATH_INFO: `/v3/projects/8475932d464b47c196c387f6c8d3edda` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:07.305298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8475932d464b47c196c387f6c8d3edda)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:07.307243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:07.479524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8475932d464b47c196c387f6c8d3edda', 'request_id': 'req-d51bb333-8d69-4580-bad5-2dbd214e8ec7'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:07.485193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8475932d464b47c196c387f6c8d3edda', 'request_id': 'req-d51bb333-8d69-4580-bad5-2dbd214e8ec7'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:07.491518 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8475932d464b47c196c387f6c8d3edda', 'request_id': 'req-d51bb333-8d69-4580-bad5-2dbd214e8ec7'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:07.609666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] The token cache is being invalidate because project 8475932d464b47c196c387f6c8d3edda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:07.609999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:07.610627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d51bb333-8d69-4580-bad5-2dbd214e8ec7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:07.612175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1216/2426] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:07 2022] DELETE /identity/v3/projects/8475932d464b47c196c387f6c8d3edda => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:07.617395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227458cc-bd76-4a21-85c7-26d31dd9daff None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:07.617887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227458cc-bd76-4a21-85c7-26d31dd9daff None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:07.618033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227458cc-bd76-4a21-85c7-26d31dd9daff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:07.676016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-227458cc-bd76-4a21-85c7-26d31dd9daff None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:07.677225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-227458cc-bd76-4a21-85c7-26d31dd9daff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:07.721327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:07.735353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1211/2427] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:07.743399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872871-9c19-4002-82d4-5a10d848f7c2 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:07.743719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872871-9c19-4002-82d4-5a10d848f7c2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:07.743996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9872871-9c19-4002-82d4-5a10d848f7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:07.764938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a9872871-9c19-4002-82d4-5a10d848f7c2 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:07.766182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a9872871-9c19-4002-82d4-5a10d848f7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:07.774681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1217/2428] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:07.778809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227458cc-bd76-4a21-85c7-26d31dd9daff None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:07.788252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227458cc-bd76-4a21-85c7-26d31dd9daff None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:07.792795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:07.793391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:07.793667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:07.793969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:07.794654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:31:07.794959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:07.796581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:07.807940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1212/2429] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:31:07.812072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872871-9c19-4002-82d4-5a10d848f7c2 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:07.821626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9872871-9c19-4002-82d4-5a10d848f7c2 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:07.826539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:07.827135 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:07.827416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:07.827688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:07.828342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:07.830289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:07.942213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1218/2430] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:07 2022] POST /identity/v3/projects => generated 379 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:07.946728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:07.956683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4da2a34-5ed5-4ba8-89da-8bbe9d3f0f05 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:08.013366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:08.014274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:08.014562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:08.014839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:08.015845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:08.017785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:08.146181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1213/2431] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:07 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:31:08.150315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:08.160538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29cc732-50c7-4fe6-9b0d-733b83bfce56 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:08.165099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:08.165710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:08.166028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:08.166313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:08.166999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:08.168586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:08.179480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1219/2432] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:08.182986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:08.193796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5d9d6-eb6f-4ca5-86fc-ad98d8b0f32e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:08.198723 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9524cf0d-5f54-43d7-87da-86e87d35d1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:08.199327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524cf0d-5f54-43d7-87da-86e87d35d1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:08.199608 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524cf0d-5f54-43d7-87da-86e87d35d1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:08.199882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9524cf0d-5f54-43d7-87da-86e87d35d1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:08.200572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524cf0d-5f54-43d7-87da-86e87d35d1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:08.202195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9524cf0d-5f54-43d7-87da-86e87d35d1e1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:08.211882 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1214/2433] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:08.215959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:08.225968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d21586-ae03-402c-a907-b15d0131307a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:08.230457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:08.231096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:08.231407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:08.231680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] PATH_INFO: `/v3/projects/d7b57f7ed0c7404cab970c7f8ddd6b9e/users/45ae2159931846c69ce246c9d375acf8/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:08.246434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7b57f7ed0c7404cab970c7f8ddd6b9e, user_id=45ae2159931846c69ce246c9d375acf8, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:08.249107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:08.351870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1220/2434] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:08 2022] PUT /identity/v3/projects/d7b57f7ed0c7404cab970c7f8ddd6b9e/users/45ae2159931846c69ce246c9d375acf8/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:08.362197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382758-d79e-4372-adb8-2be3bcba9e23 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:08.362477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382758-d79e-4372-adb8-2be3bcba9e23 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:08.362748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6382758-d79e-4372-adb8-2be3bcba9e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:08.391637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e6382758-d79e-4372-adb8-2be3bcba9e23 None None] MFA Rules not processed for user `45ae2159931846c69ce246c9d375acf8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:08.392844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e6382758-d79e-4372-adb8-2be3bcba9e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:08.456923 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1215/2435] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:08.461416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:08.467418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:08.530627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c12b121-0823-45e5-beb2-86c994e642cf admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:08.535563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:08.536694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:08.536980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:08.537256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:08.538125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:08.540114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:08.676574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1221/2436] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:08 2022] POST /identity/v3/projects => generated 379 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:08.679544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6382758-d79e-4372-adb8-2be3bcba9e23 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:08.691494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6382758-d79e-4372-adb8-2be3bcba9e23 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:08.735873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:08.748372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:08.748992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:08.749274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:08.749547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:08.750262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:08.752184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.094070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1216/2437] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:08 2022] POST /identity/v3/users => generated 290 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:09.097973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:09.109042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c02298-c5b3-46a7-928d-54452a7b8ec3 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:09.113849 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:09.115144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.115426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.115721 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.116432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:09.118229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.129821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1222/2438] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:09.133902 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:09.143799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25117fb9-f9bd-4cf6-8ea1-a1274573c816 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:09.148459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af8f113-63dc-4ba3-9331-4f8c8740854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:09.149068 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8f113-63dc-4ba3-9331-4f8c8740854d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.149346 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8f113-63dc-4ba3-9331-4f8c8740854d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.149647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af8f113-63dc-4ba3-9331-4f8c8740854d admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.150372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8f113-63dc-4ba3-9331-4f8c8740854d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:09.151974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af8f113-63dc-4ba3-9331-4f8c8740854d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.162299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1217/2439] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:09.166334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:09.176613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504bace4-ffc5-4ede-8a7c-c4bfc09f568d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:09.181754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:09.182435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.182713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.182984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] PATH_INFO: `/v3/projects/a966e65981ec42bea1400b18da0a32cf/users/0e5369f3c17f47798b4ae32e5900f8dd/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.197557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a966e65981ec42bea1400b18da0a32cf, user_id=0e5369f3c17f47798b4ae32e5900f8dd, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:09.201085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.339468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1223/2440] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:09 2022] PUT /identity/v3/projects/a966e65981ec42bea1400b18da0a32cf/users/0e5369f3c17f47798b4ae32e5900f8dd/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:09.351667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb4d7-1661-4a3e-8849-3935eb17abda None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.351910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb4d7-1661-4a3e-8849-3935eb17abda None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.352185 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84fb4d7-1661-4a3e-8849-3935eb17abda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.380789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c84fb4d7-1661-4a3e-8849-3935eb17abda None None] MFA Rules not processed for user `0e5369f3c17f47798b4ae32e5900f8dd`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:09.382060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c84fb4d7-1661-4a3e-8849-3935eb17abda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:09.443317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1218/2441] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:09 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:09.448071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:09.509274 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101b73c-99e5-4dc9-99c7-2ee2f4f65a97 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:09.514054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:09.518024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.518024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.518024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.518024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:09.518024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.681724 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1224/2442] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:09 2022] POST /identity/v3/projects => generated 377 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:31:09.682959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb4d7-1661-4a3e-8849-3935eb17abda None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:09.694004 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84fb4d7-1661-4a3e-8849-3935eb17abda None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:09.752832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:09.753449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.753728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.754175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.754872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:09.756760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.844054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1219/2443] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:09 2022] POST /identity/v3/users => generated 295 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:09.848140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:09.859183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c474ffba-74a6-4de2-9a46-21ccfafa12bc admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:09.863806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:09.864338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.864608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.864876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.865562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:09.867191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.877506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1225/2444] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:09.882103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:09.891843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245e389-dc0f-46b1-b23f-a24f097a0900 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:09.896980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:09.899101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:09.899101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:09.899101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] PATH_INFO: `/v3/projects/c031b35f12954bb6a9a1be68c1e6e657/users/768d5a053d7b427ab8cf77e71a498ba8/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:09.912379 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c031b35f12954bb6a9a1be68c1e6e657, user_id=768d5a053d7b427ab8cf77e71a498ba8, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:09.915056 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:09.990546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1220/2445] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:09 2022] PUT /identity/v3/projects/c031b35f12954bb6a9a1be68c1e6e657/users/768d5a053d7b427ab8cf77e71a498ba8/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:09.994580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:10.004569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681c43-ead6-4ebf-8d3e-d6a281466c05 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:10.030493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:10.059652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e36297-cc9a-42cd-b5a6-2413091985ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:10.060297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e36297-cc9a-42cd-b5a6-2413091985ae admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:10.060575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e36297-cc9a-42cd-b5a6-2413091985ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:10.060851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e36297-cc9a-42cd-b5a6-2413091985ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:10.061537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e36297-cc9a-42cd-b5a6-2413091985ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:10.063178 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e36297-cc9a-42cd-b5a6-2413091985ae admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:10.073614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1226/2446] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:10.078298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:10.089462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744fcb61-8996-4fb7-9bef-721ac802a93d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:10.094178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:10.094835 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:10.095116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:10.095388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] PATH_INFO: `/v3/projects/c031b35f12954bb6a9a1be68c1e6e657/users/768d5a053d7b427ab8cf77e71a498ba8/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:10.097358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c031b35f12954bb6a9a1be68c1e6e657, user_id=768d5a053d7b427ab8cf77e71a498ba8, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:10.100089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:10.110930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1221/2447] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:10 2022] PUT /identity/v3/projects/c031b35f12954bb6a9a1be68c1e6e657/users/768d5a053d7b427ab8cf77e71a498ba8/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:10.121244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:10.121532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:10.121841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:10.150425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] MFA Rules not processed for user `768d5a053d7b427ab8cf77e71a498ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:10.151624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:10.217847 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1227/2448] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:10 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:10.229289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:10.231059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:10.242962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:10.308976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b128cd5-718b-4640-a081-52ad08e422a9 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:10.312680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:10.313284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:10.313560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:10.313857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:10.323810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:10.325243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:10.335132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1222/2449] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:10 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:10.473513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:10.478322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:10.486951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae8f580-840a-4df7-9a02-8d297cd1788e None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:10.491017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53d0f4-05cf-4902-a08a-2888021f8d2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:10.491623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d0f4-05cf-4902-a08a-2888021f8d2a service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:10.491899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d0f4-05cf-4902-a08a-2888021f8d2a service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:10.492175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53d0f4-05cf-4902-a08a-2888021f8d2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:10.547512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53d0f4-05cf-4902-a08a-2888021f8d2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:10.548942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53d0f4-05cf-4902-a08a-2888021f8d2a service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:10.558453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1228/2450] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:10 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:14.922927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:14.985609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44606e-7bf4-4091-9da2-3f31b6afcec3 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:14.990164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:14.990792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:14.991100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:14.991401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] PATH_INFO: `/v3/users/45ae2159931846c69ce246c9d375acf8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:14.992530 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=45ae2159931846c69ce246c9d375acf8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:14.994886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:15.183626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45ae2159931846c69ce246c9d375acf8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:15.301138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45ae2159931846c69ce246c9d375acf8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:15.308500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45ae2159931846c69ce246c9d375acf8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:15.321216 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45ae2159931846c69ce246c9d375acf8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:15.322442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45ae2159931846c69ce246c9d375acf8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:15.328373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1223/2451] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:14 2022] DELETE /identity/v3/users/45ae2159931846c69ce246c9d375acf8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:31:15.340053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:15.340616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:15.340616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:15.360113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:15.361297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:15.407215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:15.422276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1229/2452] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:15.433281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:15.434813 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:15.450091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:15.508913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8461c0f-6f27-4a3f-b934-505acdd85d2d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:15.513130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:15.513748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:15.514057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:15.514323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:15.524243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:15.525979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:15.535375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1224/2453] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:31:16.017017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:16.018442 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:16.032983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8dff75-9e60-43f1-8469-c665a673b109 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:16.037688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:16.039391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:16.039680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:16.039948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] PATH_INFO: `/v3/projects/d7b57f7ed0c7404cab970c7f8ddd6b9e` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:16.042284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7b57f7ed0c7404cab970c7f8ddd6b9e)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:16.044601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:16.151075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7b57f7ed0c7404cab970c7f8ddd6b9e', 'request_id': 'req-c603eed2-028a-4549-8d98-03242aa3d72c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.156559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7b57f7ed0c7404cab970c7f8ddd6b9e', 'request_id': 'req-c603eed2-028a-4549-8d98-03242aa3d72c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.162650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7b57f7ed0c7404cab970c7f8ddd6b9e', 'request_id': 'req-c603eed2-028a-4549-8d98-03242aa3d72c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.258434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] The token cache is being invalidate because project d7b57f7ed0c7404cab970c7f8ddd6b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:16.258722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.259377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.260934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1230/2454] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:16 2022] DELETE /identity/v3/projects/d7b57f7ed0c7404cab970c7f8ddd6b9e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:16.264957 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:16.274484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b207ce1-39ac-434f-8ca3-042e97c80116 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:16.331092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:16.331733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:16.332014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:16.332290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] PATH_INFO: `/v3/users/0e5369f3c17f47798b4ae32e5900f8dd` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:16.333439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5369f3c17f47798b4ae32e5900f8dd)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:16.335384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:16.573694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5369f3c17f47798b4ae32e5900f8dd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.688443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5369f3c17f47798b4ae32e5900f8dd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.696174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5369f3c17f47798b4ae32e5900f8dd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.711459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5369f3c17f47798b4ae32e5900f8dd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.712175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5369f3c17f47798b4ae32e5900f8dd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:16.718867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1225/2455] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:16 2022] DELETE /identity/v3/users/0e5369f3c17f47798b4ae32e5900f8dd => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:17.176845 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:17.182008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:17.193999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603eed2-028a-4549-8d98-03242aa3d72c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:17.250773 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:17.251341 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:17.251617 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:17.251886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] PATH_INFO: `/v3/projects/a966e65981ec42bea1400b18da0a32cf` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:17.253016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a966e65981ec42bea1400b18da0a32cf)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:17.254977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:17.411018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a966e65981ec42bea1400b18da0a32cf', 'request_id': 'req-dad516b5-813b-477b-af75-f0cd049e7c25'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:17.416487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a966e65981ec42bea1400b18da0a32cf', 'request_id': 'req-dad516b5-813b-477b-af75-f0cd049e7c25'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:17.422734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a966e65981ec42bea1400b18da0a32cf', 'request_id': 'req-dad516b5-813b-477b-af75-f0cd049e7c25'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:17.615117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] The token cache is being invalidate because project a966e65981ec42bea1400b18da0a32cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:17.615349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:17.615920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:17.617443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1231/2456] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:17 2022] DELETE /identity/v3/projects/a966e65981ec42bea1400b18da0a32cf => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:17.622006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:17.623408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:17.636812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0ead9-5d6d-430a-8526-2b566c52bd28 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:17.654211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:17.693032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:17.693676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:17.693986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:17.694263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] PATH_INFO: `/v3/users/768d5a053d7b427ab8cf77e71a498ba8` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:17.695437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] RBAC: Authorizing `identity:delete_user(user_id=768d5a053d7b427ab8cf77e71a498ba8)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:17.698047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:18.034279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '768d5a053d7b427ab8cf77e71a498ba8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.110770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '768d5a053d7b427ab8cf77e71a498ba8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.118411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '768d5a053d7b427ab8cf77e71a498ba8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.130976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '768d5a053d7b427ab8cf77e71a498ba8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.131655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-310083a9-81d7-4194-a26b-024248ac375a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '768d5a053d7b427ab8cf77e71a498ba8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.137646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1226/2457] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:17 2022] DELETE /identity/v3/users/768d5a053d7b427ab8cf77e71a498ba8 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:18.575466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:18.577058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:18.588281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:18.591509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad516b5-813b-477b-af75-f0cd049e7c25 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:18.648638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:18.649317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:18.650155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:18.650440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] PATH_INFO: `/v3/projects/c031b35f12954bb6a9a1be68c1e6e657` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:18.651614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c031b35f12954bb6a9a1be68c1e6e657)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:18.653514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:18.804843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c031b35f12954bb6a9a1be68c1e6e657', 'request_id': 'req-716ffe19-08a8-448d-af29-a14e38c81b72'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.810354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c031b35f12954bb6a9a1be68c1e6e657', 'request_id': 'req-716ffe19-08a8-448d-af29-a14e38c81b72'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.816483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c031b35f12954bb6a9a1be68c1e6e657', 'request_id': 'req-716ffe19-08a8-448d-af29-a14e38c81b72'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.909757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] The token cache is being invalidate because project c031b35f12954bb6a9a1be68c1e6e657 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:18.909988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.910608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-716ffe19-08a8-448d-af29-a14e38c81b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:18.912130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1232/2458] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:18 2022] DELETE /identity/v3/projects/c031b35f12954bb6a9a1be68c1e6e657 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:18.918166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783159-9e04-4311-bb70-710880d543d7 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:18.918638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783159-9e04-4311-bb70-710880d543d7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:18.918743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb783159-9e04-4311-bb70-710880d543d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:18.938043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-eb783159-9e04-4311-bb70-710880d543d7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:18.939323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-eb783159-9e04-4311-bb70-710880d543d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:18.997338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1227/2459] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:31:19.005854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a6cc-9576-4e9c-85ba-b25c968beb63 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.006149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a6cc-9576-4e9c-85ba-b25c968beb63 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.006419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c1a6cc-9576-4e9c-85ba-b25c968beb63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.027155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-93c1a6cc-9576-4e9c-85ba-b25c968beb63 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:19.028373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-93c1a6cc-9576-4e9c-85ba-b25c968beb63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:19.038385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1233/2460] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:19.042711 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb783159-9e04-4311-bb70-710880d543d7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:19.052328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb783159-9e04-4311-bb70-710880d543d7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:19.056906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:19.057520 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.057816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.058090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.064918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:31:19.064918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:19.064918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:19.073291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1228/2461] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:31:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:31:19.077740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1a6cc-9576-4e9c-85ba-b25c968beb63 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:19.087781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c1a6cc-9576-4e9c-85ba-b25c968beb63 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:19.092583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:19.093201 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.093486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.093783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.094671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:19.096592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:19.187277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1234/2462] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:19 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:19.191505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:19.202137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbdfe50-7bad-459e-bdfb-e0d9a2b5537d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:19.226642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:19.258121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:19.258730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.259571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.259857 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.260515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:19.262456 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:19.352225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1229/2463] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:19 2022] POST /identity/v3/users => generated 287 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:19.356311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:19.366691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496009b3-4ecb-4dc2-979a-89b3e10158c7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:19.371994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:19.372493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.372781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.373057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.373753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:19.375447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:19.386763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1235/2464] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:19.390719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:19.400578 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ee7418-41c9-4525-9b75-96ba6fc82d7e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:19.405065 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1013846-e5b5-4a0a-a37a-5d2dd0357f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:19.405692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013846-e5b5-4a0a-a37a-5d2dd0357f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.405999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013846-e5b5-4a0a-a37a-5d2dd0357f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.406266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1013846-e5b5-4a0a-a37a-5d2dd0357f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.406942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1013846-e5b5-4a0a-a37a-5d2dd0357f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:19.408513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1013846-e5b5-4a0a-a37a-5d2dd0357f51 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:19.418796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1230/2465] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:19.422712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:19.433053 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f344e5f9-242d-4f5f-8005-f66b9b474cf9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:19.437733 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:19.438362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.438644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.438924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] PATH_INFO: `/v3/projects/6bd6daf5817b413aa4a61f3ee4f1b08e/users/bf09c3f3fda846a8b6541504979527a4/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.454039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd6daf5817b413aa4a61f3ee4f1b08e, user_id=bf09c3f3fda846a8b6541504979527a4, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:19.456683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:19.575919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1236/2466] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:19 2022] PUT /identity/v3/projects/6bd6daf5817b413aa4a61f3ee4f1b08e/users/bf09c3f3fda846a8b6541504979527a4/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:19.581101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3042231-721d-4a5e-a76e-5172fbbff1d8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.581416 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3042231-721d-4a5e-a76e-5172fbbff1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.581714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3042231-721d-4a5e-a76e-5172fbbff1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.601170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d3042231-721d-4a5e-a76e-5172fbbff1d8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:19.602557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d3042231-721d-4a5e-a76e-5172fbbff1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:19.661093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1231/2467] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:19.671363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:19.673025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:19.706630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:19.740508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff88dd1-1991-4420-8d8b-943984e036e7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:19.745213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:19.745863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:19.746144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:19.746419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:19.755539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:19.757059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:19.768319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1237/2468] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:21.582873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988ede-4fa8-4374-8a7c-f454a6ef1856 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:21.583427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988ede-4fa8-4374-8a7c-f454a6ef1856 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:21.583427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8988ede-4fa8-4374-8a7c-f454a6ef1856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:21.614728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d8988ede-4fa8-4374-8a7c-f454a6ef1856 None None] MFA Rules not processed for user `bf09c3f3fda846a8b6541504979527a4`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:21.615969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d8988ede-4fa8-4374-8a7c-f454a6ef1856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:21.686143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1232/2469] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:21.688675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:21.699431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d006d02-cc51-4013-af5a-47c7bcc04525 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:21.704155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:21.704772 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:21.709690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:21.709690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:21.709690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:21.709690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:21.800091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1238/2470] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:21 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:21.804284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8988ede-4fa8-4374-8a7c-f454a6ef1856 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:21.816164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8988ede-4fa8-4374-8a7c-f454a6ef1856 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:21.847907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:21.871920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:21.872527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:21.872802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:21.873070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:21.873728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:21.875655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:21.952948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1233/2471] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:21 2022] POST /identity/v3/users => generated 292 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:21.956828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:21.967057 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9eef9-b422-4450-b393-e57f58f8ea07 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:21.971720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:21.972322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:21.972603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:21.972878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:21.973565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:21.975183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:21.986217 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1239/2472] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:21.995910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:22.006054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bb861c-2d2b-4455-95f9-d19dfdd54e91 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:22.010708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:22.011363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:22.011646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:22.011922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] PATH_INFO: `/v3/projects/078cefa2f07841bf83598bd8bbb9ca75/users/dbea734d227541b0910c0b57c0c10ee2/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:22.026331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078cefa2f07841bf83598bd8bbb9ca75, user_id=dbea734d227541b0910c0b57c0c10ee2, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:22.028989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:22.111641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1234/2473] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:21 2022] PUT /identity/v3/projects/078cefa2f07841bf83598bd8bbb9ca75/users/dbea734d227541b0910c0b57c0c10ee2/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:22.121060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:22.131298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009e2ab-3d4f-4b77-a764-c5590eeb644a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:22.187915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c504d302-5fbd-4ad9-9c6c-d1aff6b73da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:22.188527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d302-5fbd-4ad9-9c6c-d1aff6b73da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:22.188840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d302-5fbd-4ad9-9c6c-d1aff6b73da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:22.189114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c504d302-5fbd-4ad9-9c6c-d1aff6b73da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:22.189828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504d302-5fbd-4ad9-9c6c-d1aff6b73da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:22.191439 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c504d302-5fbd-4ad9-9c6c-d1aff6b73da0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:22.202246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1240/2474] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:22 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:22.206138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:22.217192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288f6ed2-abaa-4861-8607-c1ab1d2c6440 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:22.221806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:22.222476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:22.222939 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:22.223219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] PATH_INFO: `/v3/projects/078cefa2f07841bf83598bd8bbb9ca75/users/dbea734d227541b0910c0b57c0c10ee2/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:22.225191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=078cefa2f07841bf83598bd8bbb9ca75, user_id=dbea734d227541b0910c0b57c0c10ee2, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:22.227911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:22.239174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1235/2475] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:22 2022] PUT /identity/v3/projects/078cefa2f07841bf83598bd8bbb9ca75/users/dbea734d227541b0910c0b57c0c10ee2/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:23.885525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:23.888432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:23.888432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:23.938186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] MFA Rules not processed for user `dbea734d227541b0910c0b57c0c10ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:23.943407 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:24.073587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1241/2476] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:23 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:24.085470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:24.089070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:24.155227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faee61a-090e-46be-910b-dbbea1efb477 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:24.158932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:24.159555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:24.159838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:24.160110 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:24.237164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:24.238678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:24.248911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1236/2477] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:26.116458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:26.118132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:26.131829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d5d470-07dd-4c64-a500-6ff970bb11bc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:26.135460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:26.139543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:26.139543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:26.139543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:26.147520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:26.148938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:26.158610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1242/2478] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:29.318102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:29.361981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:29.371706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c4eaa-2541-48fa-9eda-066cc520d274 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:29.375916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:29.376522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:29.376796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:29.377063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:29.378866 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:29.439897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:29.441317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:29.451143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1237/2479] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:33.382932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:33.385224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:33.400331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578edbf9-615e-4187-beac-4691bf38ebb0 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:33.405826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:33.406389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:33.406667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:33.406944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] PATH_INFO: `/v3/users/9297f4c0b9c34321aee707525b2371a8` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:33.408198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9297f4c0b9c34321aee707525b2371a8)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:33.410177 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:33.411896 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:33.633460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9297f4c0b9c34321aee707525b2371a8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:33.634106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9297f4c0b9c34321aee707525b2371a8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:33.646743 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9297f4c0b9c34321aee707525b2371a8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:33.647392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9297f4c0b9c34321aee707525b2371a8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:33.746369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5c3b1b25-99a7-4999-b5a6-b3b3b6e334f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9297f4c0b9c34321aee707525b2371a8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:33.759158 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1243/2480] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:33 2022] DELETE /identity/v3/users/9297f4c0b9c34321aee707525b2371a8 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:34.034581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:34.050576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d1b14-2369-40b6-856f-4ed494660f97 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:34.105321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:34.106000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:34.106275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:34.106542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] PATH_INFO: `/v3/projects/1e1ecdf838df4b5780b87c86acc4fe02` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:34.108295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1ecdf838df4b5780b87c86acc4fe02)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:34.110227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:34.226033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1ecdf838df4b5780b87c86acc4fe02', 'request_id': 'req-13384945-9b05-4d68-a0cd-f31e00341382'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:34.334190 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1ecdf838df4b5780b87c86acc4fe02', 'request_id': 'req-13384945-9b05-4d68-a0cd-f31e00341382'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:34.340564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1ecdf838df4b5780b87c86acc4fe02', 'request_id': 'req-13384945-9b05-4d68-a0cd-f31e00341382'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:34.352171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] The token cache is being invalidate because project 1e1ecdf838df4b5780b87c86acc4fe02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:34.352748 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:34.353157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-13384945-9b05-4d68-a0cd-f31e00341382 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:34.355093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1238/2481] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:34 2022] DELETE /identity/v3/projects/1e1ecdf838df4b5780b87c86acc4fe02 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:34.360501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540014d-cfab-402c-9a25-c1be1a0376d4 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:34.360789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540014d-cfab-402c-9a25-c1be1a0376d4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:34.361069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540014d-cfab-402c-9a25-c1be1a0376d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:34.380687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-f540014d-cfab-402c-9a25-c1be1a0376d4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:34.381956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f540014d-cfab-402c-9a25-c1be1a0376d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:34.442190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1244/2482] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:34.450996 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94ff9-f754-4c54-8f62-7b462308c739 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:34.451276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94ff9-f754-4c54-8f62-7b462308c739 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:34.451567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef94ff9-f754-4c54-8f62-7b462308c739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:34.471508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-eef94ff9-f754-4c54-8f62-7b462308c739 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:34.473953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-eef94ff9-f754-4c54-8f62-7b462308c739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:34.480539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1239/2483] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:34.484856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540014d-cfab-402c-9a25-c1be1a0376d4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:34.494636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540014d-cfab-402c-9a25-c1be1a0376d4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:34.499501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:34.500125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:34.500392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:34.500667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:34.501427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:31:34.501989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:34.503765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:34.516281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1245/2484] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:31:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:31:34.520600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef94ff9-f754-4c54-8f62-7b462308c739 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:34.530493 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef94ff9-f754-4c54-8f62-7b462308c739 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:34.535536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:34.536132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:34.539008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:34.539008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:34.539008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:34.539308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:34.554789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:34.713076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1240/2485] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:34 2022] POST /identity/v3/projects => generated 373 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:34.717988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:34.727922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc18e9a-5a1a-4f48-a8b0-114fb2ba0888 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:34.784514 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:34.785134 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:34.785417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:34.785718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:34.786416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:34.788382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:34.806205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:34.992884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1246/2486] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:34 2022] POST /identity/v3/users => generated 287 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:31:34.997654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.009547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbb1133-b458-4e7c-8301-340bfbdf03ec admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.015843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.016707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.017051 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.017477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.018281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.020036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.030734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1241/2487] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:35.034960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.045110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c71b8-ea06-445f-88a3-d36da04a892d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.050016 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c50f13-5311-4854-9af7-9c639184be5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.050628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c50f13-5311-4854-9af7-9c639184be5d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.050907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c50f13-5311-4854-9af7-9c639184be5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.051179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c50f13-5311-4854-9af7-9c639184be5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.051891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c50f13-5311-4854-9af7-9c639184be5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.053480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c50f13-5311-4854-9af7-9c639184be5d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.065007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1247/2488] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:31:35.069357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.081208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31915882-e97b-41da-9bf9-235188092a90 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.086175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.088335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.088335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.088335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] PATH_INFO: `/v3/projects/9f466b7653224c968270251cae9f646c/users/ae29177f4503447ab862d224e1822898/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.104353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f466b7653224c968270251cae9f646c, user_id=ae29177f4503447ab862d224e1822898, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.108239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.203494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1242/2489] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:35 2022] PUT /identity/v3/projects/9f466b7653224c968270251cae9f646c/users/ae29177f4503447ab862d224e1822898/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:35.213831 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4a1d-692c-47e2-8d57-ff6a53abbb8f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.214124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4a1d-692c-47e2-8d57-ff6a53abbb8f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.214404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff4a1d-692c-47e2-8d57-ff6a53abbb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.242890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-23ff4a1d-692c-47e2-8d57-ff6a53abbb8f None None] MFA Rules not processed for user `ae29177f4503447ab862d224e1822898`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:35.244110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-23ff4a1d-692c-47e2-8d57-ff6a53abbb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:35.309424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1248/2490] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:35.314587 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.377092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd52b8-2e5c-415b-829a-f4acc0d7845b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.381777 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.382399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.382685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.382934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.383622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.385475 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.495275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1243/2491] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:35 2022] POST /identity/v3/projects => generated 373 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:35.500014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4a1d-692c-47e2-8d57-ff6a53abbb8f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.511092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff4a1d-692c-47e2-8d57-ff6a53abbb8f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.568354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.568971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.569250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.569523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.570212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.572408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.688173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1249/2492] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:35 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:35.692534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.703480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49ac9ca-86da-437e-a358-c8ea9151e4a8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.708234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.708826 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.709105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.709377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.710200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.711793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.722985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1244/2493] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:35.727216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.738070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3677cb09-2e4a-4695-8d04-95e007c86f8e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.742739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.743403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.743687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.743987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] PATH_INFO: `/v3/projects/60d8030ba3b54587b131213f7ac66932/users/9f272c86023445988ccd3d6dee8773de/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.759149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d8030ba3b54587b131213f7ac66932, user_id=9f272c86023445988ccd3d6dee8773de, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.761255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.848967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1250/2494] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:35 2022] PUT /identity/v3/projects/60d8030ba3b54587b131213f7ac66932/users/9f272c86023445988ccd3d6dee8773de/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:31:35.852964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.862819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692136d6-66d3-4cde-b1e2-2ad3e5207802 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.921182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9021d4b-57d1-4f6e-8bf5-5f92600969c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.921831 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021d4b-57d1-4f6e-8bf5-5f92600969c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.922114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021d4b-57d1-4f6e-8bf5-5f92600969c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.922392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9021d4b-57d1-4f6e-8bf5-5f92600969c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.923096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9021d4b-57d1-4f6e-8bf5-5f92600969c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.924745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9021d4b-57d1-4f6e-8bf5-5f92600969c9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.934758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1245/2495] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:35.938975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:35.949932 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d4d4d1-9232-41eb-96ea-4f76620a2d77 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:35.955690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:35.956355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.956636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.956912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] PATH_INFO: `/v3/projects/60d8030ba3b54587b131213f7ac66932/users/9f272c86023445988ccd3d6dee8773de/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:35.958947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d8030ba3b54587b131213f7ac66932, user_id=9f272c86023445988ccd3d6dee8773de, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:35.961683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:35.972689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1251/2496] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:35 2022] PUT /identity/v3/projects/60d8030ba3b54587b131213f7ac66932/users/9f272c86023445988ccd3d6dee8773de/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:35.984439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311364e1-8812-4573-b2b9-119e105e577c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:35.984726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311364e1-8812-4573-b2b9-119e105e577c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:35.985003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311364e1-8812-4573-b2b9-119e105e577c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:36.011949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-311364e1-8812-4573-b2b9-119e105e577c None None] MFA Rules not processed for user `9f272c86023445988ccd3d6dee8773de`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:36.013083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-311364e1-8812-4573-b2b9-119e105e577c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:36.030347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:36.080407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1246/2497] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:35 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:36.091390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:36.093696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:36.134999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:36.166687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500f116-d50e-4542-b99a-f00105ee9c4f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:36.170616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:36.171237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:36.171519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:36.171815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:36.184995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:36.184995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:36.193511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1252/2498] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:36 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:36.508407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311364e1-8812-4573-b2b9-119e105e577c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:36.518962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311364e1-8812-4573-b2b9-119e105e577c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:36.522684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:36.523322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:36.523603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:36.525440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:36.584367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:36.588641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:36.595501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1247/2499] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:43.014897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:43.017937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:43.085858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c471f3b8-b04b-40c6-8062-4e4bee723376 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:43.090411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:43.091056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:43.091336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:43.091612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] PATH_INFO: `/v3/users/bf09c3f3fda846a8b6541504979527a4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:43.092781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf09c3f3fda846a8b6541504979527a4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:43.094745 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:43.271968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf09c3f3fda846a8b6541504979527a4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.272655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf09c3f3fda846a8b6541504979527a4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.284747 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf09c3f3fda846a8b6541504979527a4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.285388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf09c3f3fda846a8b6541504979527a4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.355779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf09c3f3fda846a8b6541504979527a4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.368789 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1253/2500] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:43 2022] DELETE /identity/v3/users/bf09c3f3fda846a8b6541504979527a4 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:43.638507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:43.650333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b9351-0bc0-4ed0-8da2-13163d0bac10 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:43.710958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:43.711604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:43.711883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:43.712158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] PATH_INFO: `/v3/projects/6bd6daf5817b413aa4a61f3ee4f1b08e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:43.713391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd6daf5817b413aa4a61f3ee4f1b08e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:43.715388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:43.820033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd6daf5817b413aa4a61f3ee4f1b08e', 'request_id': 'req-bbec1fd4-858b-48e7-962d-e76fc722af6b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.824071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:43.893640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd6daf5817b413aa4a61f3ee4f1b08e', 'request_id': 'req-bbec1fd4-858b-48e7-962d-e76fc722af6b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.900039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd6daf5817b413aa4a61f3ee4f1b08e', 'request_id': 'req-bbec1fd4-858b-48e7-962d-e76fc722af6b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.913468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] The token cache is being invalidate because project 6bd6daf5817b413aa4a61f3ee4f1b08e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:43.915414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.916067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:43.919230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1248/2501] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:43 2022] DELETE /identity/v3/projects/6bd6daf5817b413aa4a61f3ee4f1b08e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:43.923727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:43.925128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:43.946875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a9a38-5b9f-455a-9013-9b859f455f90 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:43.993784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:44.005821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:44.006522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:44.006799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:44.007071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] PATH_INFO: `/v3/users/dbea734d227541b0910c0b57c0c10ee2` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:44.008255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbea734d227541b0910c0b57c0c10ee2)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:44.010216 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:44.250052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbea734d227541b0910c0b57c0c10ee2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.250733 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbea734d227541b0910c0b57c0c10ee2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.263056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbea734d227541b0910c0b57c0c10ee2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.263927 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbea734d227541b0910c0b57c0c10ee2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.385007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7f31cab5-b7db-4db7-a608-dd2bd18fe9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbea734d227541b0910c0b57c0c10ee2'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.397675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1254/2502] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:43 2022] DELETE /identity/v3/users/dbea734d227541b0910c0b57c0c10ee2 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:44.643230 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:44.655999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:44.661220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbec1fd4-858b-48e7-962d-e76fc722af6b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:44.719764 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:44.720422 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:44.720676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:44.720945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] PATH_INFO: `/v3/projects/078cefa2f07841bf83598bd8bbb9ca75` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:44.722114 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=078cefa2f07841bf83598bd8bbb9ca75)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:44.724655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:44.838076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '078cefa2f07841bf83598bd8bbb9ca75', 'request_id': 'req-ad1017dd-b390-4690-b707-9595d02ecbf6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.921861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '078cefa2f07841bf83598bd8bbb9ca75', 'request_id': 'req-ad1017dd-b390-4690-b707-9595d02ecbf6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.929898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '078cefa2f07841bf83598bd8bbb9ca75', 'request_id': 'req-ad1017dd-b390-4690-b707-9595d02ecbf6'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.941315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] The token cache is being invalidate because project 078cefa2f07841bf83598bd8bbb9ca75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:44.941605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.942505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ad1017dd-b390-4690-b707-9595d02ecbf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:44.944244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1249/2503] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:44 2022] DELETE /identity/v3/projects/078cefa2f07841bf83598bd8bbb9ca75 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:44.949239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea9ec8-3e39-4a38-8fde-ea7e86696711 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:44.959655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea9ec8-3e39-4a38-8fde-ea7e86696711 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:44.959655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea9ec8-3e39-4a38-8fde-ea7e86696711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:44.969659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-74ea9ec8-3e39-4a38-8fde-ea7e86696711 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:44.970889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-74ea9ec8-3e39-4a38-8fde-ea7e86696711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:45.030436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1255/2504] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:45.040153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee486-1595-4942-a007-be0973143b92 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.040440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee486-1595-4942-a007-be0973143b92 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.040849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aee486-1595-4942-a007-be0973143b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.060465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-81aee486-1595-4942-a007-be0973143b92 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:45.061668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-81aee486-1595-4942-a007-be0973143b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:45.070400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1250/2505] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:45.074589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea9ec8-3e39-4a38-8fde-ea7e86696711 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:45.084968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea9ec8-3e39-4a38-8fde-ea7e86696711 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:45.089575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:45.090229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.090509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.090786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.091478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:31:45.091784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:45.093382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:45.107221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1256/2506] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:31:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:31:45.111366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee486-1595-4942-a007-be0973143b92 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:45.120827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aee486-1595-4942-a007-be0973143b92 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:45.125515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:45.126166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.133180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.133180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.133180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:45.133180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:45.245045 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1251/2507] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:45 2022] POST /identity/v3/projects => generated 383 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:31:45.249202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:45.260082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eedb6c4-cf0e-4870-9e08-c23ff0e88029 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:45.318102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:45.326632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:45.327254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.327535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.327807 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.328540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:45.330966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:45.534422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1257/2508] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:45 2022] POST /identity/v3/users => generated 292 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:45.538345 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:45.550714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb931e-18c5-47a2-9053-75d398482da4 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:45.553698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:45.554349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.554631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.554909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.555595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:45.557194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:45.568289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1252/2509] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:45.572375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:45.582418 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3876-69fc-4099-a499-9262895d2367 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:45.586931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b638fcbd-1ef8-4a85-b4a4-902f53bda983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:45.587528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638fcbd-1ef8-4a85-b4a4-902f53bda983 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.587806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638fcbd-1ef8-4a85-b4a4-902f53bda983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.588075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b638fcbd-1ef8-4a85-b4a4-902f53bda983 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.588750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638fcbd-1ef8-4a85-b4a4-902f53bda983 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:45.590399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b638fcbd-1ef8-4a85-b4a4-902f53bda983 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:45.600727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1258/2510] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:45.611193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:45.621714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bf8f6-1591-42c0-9439-03b8bd889c6a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:45.626509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:45.627174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.627453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.627725 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] PATH_INFO: `/v3/projects/30eb02dd13454c818ca8904282921232/users/41cd772a220843a7932b9ef1a2aa2528/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.643433 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30eb02dd13454c818ca8904282921232, user_id=41cd772a220843a7932b9ef1a2aa2528, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:45.646161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:45.750852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1253/2511] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:45 2022] PUT /identity/v3/projects/30eb02dd13454c818ca8904282921232/users/41cd772a220843a7932b9ef1a2aa2528/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:45.761970 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652267b-6432-445c-b20f-471697b285f6 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.762255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652267b-6432-445c-b20f-471697b285f6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.762527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652267b-6432-445c-b20f-471697b285f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.790184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0652267b-6432-445c-b20f-471697b285f6 None None] MFA Rules not processed for user `41cd772a220843a7932b9ef1a2aa2528`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:45.791431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0652267b-6432-445c-b20f-471697b285f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:45.855106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1259/2512] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:45.859616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:45.870290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:45.919446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b014c1b7-004c-4a4c-aa00-7a081f09a44c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:45.923998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:45.924583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:45.924855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:45.925153 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:45.925820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:45.928357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:46.032469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1254/2513] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:31:45 2022] POST /identity/v3/projects => generated 385 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:46.037085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652267b-6432-445c-b20f-471697b285f6 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:46.047790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652267b-6432-445c-b20f-471697b285f6 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:46.107257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:46.108326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:46.108605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:46.108873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:46.109543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:46.111583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:46.259637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1260/2514] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:31:46 2022] POST /identity/v3/users => generated 299 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:31:46.263878 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:46.274449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a494da-f1c8-46e4-b7ca-d53d4667cf8c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:46.278933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:46.279531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:46.279811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:46.280085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:46.280759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:46.282391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:46.293323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1255/2515] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:46.297282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:46.307388 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec41f3e2-81dd-4eeb-b19d-527bc2ff6907 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:46.312236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:46.314711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:46.314711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:46.314711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] PATH_INFO: `/v3/projects/ede9ce57f37441e9a02174dbea7cd6a0/users/0444bc9150c24a31822f5828f914d138/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:46.328290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede9ce57f37441e9a02174dbea7cd6a0, user_id=0444bc9150c24a31822f5828f914d138, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:46.330987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:46.469105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1261/2516] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:46 2022] PUT /identity/v3/projects/ede9ce57f37441e9a02174dbea7cd6a0/users/0444bc9150c24a31822f5828f914d138/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:31:46.474118 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:46.484180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89a9ef-1761-456f-b0e0-2ad3250d9e93 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:46.539926 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e83336-43a8-4eac-b2b9-7eb83ebf0acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:46.540540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e83336-43a8-4eac-b2b9-7eb83ebf0acc admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:46.540820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e83336-43a8-4eac-b2b9-7eb83ebf0acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:46.541093 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e83336-43a8-4eac-b2b9-7eb83ebf0acc admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:46.541781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e83336-43a8-4eac-b2b9-7eb83ebf0acc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:46.543390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e83336-43a8-4eac-b2b9-7eb83ebf0acc admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:46.553008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1256/2517] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:31:46.557140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:46.567988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a111848-bf33-45fc-aa2f-bb0a86d1d521 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:46.573184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:46.573865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:46.574145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:46.574419 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] PATH_INFO: `/v3/projects/ede9ce57f37441e9a02174dbea7cd6a0/users/0444bc9150c24a31822f5828f914d138/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:46.576379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede9ce57f37441e9a02174dbea7cd6a0, user_id=0444bc9150c24a31822f5828f914d138, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:46.579043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:46.590127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1262/2518] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:31:46 2022] PUT /identity/v3/projects/ede9ce57f37441e9a02174dbea7cd6a0/users/0444bc9150c24a31822f5828f914d138/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:46.600070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:46.600354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:46.600637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:46.628055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] MFA Rules not processed for user `0444bc9150c24a31822f5828f914d138`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:46.629753 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:46.699108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1257/2519] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:46 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:46.711197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:46.713018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:46.732463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:46.773029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfab432-4167-4a53-9390-fc9f63b349e5 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:46.776770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:46.777385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:46.777755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:46.778287 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:46.835526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:46.836992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:46.846226 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1263/2520] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:52.181377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:52.182823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:52.190955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:52.195794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0540feb-0007-46fd-a647-d87db0b124e4 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:52.199394 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a704c3a-4950-4242-af5d-5bf560ff510d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:52.200021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704c3a-4950-4242-af5d-5bf560ff510d service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:52.200290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704c3a-4950-4242-af5d-5bf560ff510d service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:52.200554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a704c3a-4950-4242-af5d-5bf560ff510d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:52.211317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a704c3a-4950-4242-af5d-5bf560ff510d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:52.212728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a704c3a-4950-4242-af5d-5bf560ff510d service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:52.222238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1258/2521] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:52 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:56.841793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=41 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:31:58.685871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:58.748402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1097e032-44ed-4a2a-8cd0-61a2637475d2 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:58.753234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:58.753912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:58.754195 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:58.754469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] PATH_INFO: `/v3/users/41cd772a220843a7932b9ef1a2aa2528` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:58.755632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41cd772a220843a7932b9ef1a2aa2528)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:58.758138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:59.015424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41cd772a220843a7932b9ef1a2aa2528'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.016099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41cd772a220843a7932b9ef1a2aa2528'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.028872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41cd772a220843a7932b9ef1a2aa2528'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.029507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41cd772a220843a7932b9ef1a2aa2528'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.103982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41cd772a220843a7932b9ef1a2aa2528'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.117083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1264/2522] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:31:58 2022] DELETE /identity/v3/users/41cd772a220843a7932b9ef1a2aa2528 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:31:59.121540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:59.122022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:59.122141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:59.140738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:31:59.141960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:59.199411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1259/2523] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:31:59.209784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:59.211192 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:59.267906 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774fda3a-e993-44f2-b705-f7306657c713 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:59.272116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:59.272981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:59.273377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:59.273979 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:59.282987 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:59.284403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:59.294312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1265/2524] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:31:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:31:59.756972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:31:59.758674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:31:59.771127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f35af59-daf5-4602-90e0-943ff9ae00f3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:31:59.776688 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:31:59.777329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:31:59.777735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:31:59.778058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] PATH_INFO: `/v3/projects/30eb02dd13454c818ca8904282921232` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:31:59.779207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30eb02dd13454c818ca8904282921232)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:31:59.781245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:31:59.882694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30eb02dd13454c818ca8904282921232', 'request_id': 'req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.978250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30eb02dd13454c818ca8904282921232', 'request_id': 'req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.984049 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30eb02dd13454c818ca8904282921232', 'request_id': 'req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.995770 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] The token cache is being invalidate because project 30eb02dd13454c818ca8904282921232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:31:59.996055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.996713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:31:59.998244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1260/2525] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:31:59 2022] DELETE /identity/v3/projects/30eb02dd13454c818ca8904282921232 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:00.002281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:00.011960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001f1aa3-e936-420f-9b50-e0652bf88146 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:00.029985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:00.069788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:00.070583 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:00.071251 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:00.071660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] PATH_INFO: `/v3/users/0444bc9150c24a31822f5828f914d138` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:00.072819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0444bc9150c24a31822f5828f914d138)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:00.074829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:00.323022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0444bc9150c24a31822f5828f914d138'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:00.323677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0444bc9150c24a31822f5828f914d138'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:00.336528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0444bc9150c24a31822f5828f914d138'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:00.337186 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0444bc9150c24a31822f5828f914d138'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:00.480523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2eb12ad1-e604-4dfa-8e5d-9c34589733f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0444bc9150c24a31822f5828f914d138'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:00.493052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1266/2526] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:00 2022] DELETE /identity/v3/users/0444bc9150c24a31822f5828f914d138 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:01.134274 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:01.135728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:01.149072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e2fd05-493a-40eb-8eb0-65ea5e0d3328 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:01.206990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:01.207640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:01.207919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:01.208195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] PATH_INFO: `/v3/projects/ede9ce57f37441e9a02174dbea7cd6a0` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:01.209339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede9ce57f37441e9a02174dbea7cd6a0)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:01.211810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:01.228962 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:01.408172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede9ce57f37441e9a02174dbea7cd6a0', 'request_id': 'req-4204614a-bb39-4fbd-be70-1ef63ebca6b1'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:01.537986 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede9ce57f37441e9a02174dbea7cd6a0', 'request_id': 'req-4204614a-bb39-4fbd-be70-1ef63ebca6b1'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:01.543704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede9ce57f37441e9a02174dbea7cd6a0', 'request_id': 'req-4204614a-bb39-4fbd-be70-1ef63ebca6b1'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:01.554581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] The token cache is being invalidate because project ede9ce57f37441e9a02174dbea7cd6a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:01.555148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:01.556364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4204614a-bb39-4fbd-be70-1ef63ebca6b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:01.558014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1261/2527] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:01 2022] DELETE /identity/v3/projects/ede9ce57f37441e9a02174dbea7cd6a0 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:01.564349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f653d-57d5-468f-8479-db46119e19f8 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:01.564828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f653d-57d5-468f-8479-db46119e19f8 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:01.564954 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844f653d-57d5-468f-8479-db46119e19f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:01.585076 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-844f653d-57d5-468f-8479-db46119e19f8 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:01.586945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-844f653d-57d5-468f-8479-db46119e19f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:01.643603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1267/2528] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:01.652488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0535ded-09ae-49e7-bb3f-30ba13eba3fc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:01.652774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0535ded-09ae-49e7-bb3f-30ba13eba3fc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:01.653050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0535ded-09ae-49e7-bb3f-30ba13eba3fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:01.672412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d0535ded-09ae-49e7-bb3f-30ba13eba3fc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:01.673612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d0535ded-09ae-49e7-bb3f-30ba13eba3fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:01.681547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1262/2529] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:01.685684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f653d-57d5-468f-8479-db46119e19f8 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:01.696056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844f653d-57d5-468f-8479-db46119e19f8 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:01.700565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:01.701163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:01.701438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:01.701707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:01.702409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:32:01.702705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:01.704296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:01.717218 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1268/2530] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 27 18:32:01.721512 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0535ded-09ae-49e7-bb3f-30ba13eba3fc None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:01.730563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0535ded-09ae-49e7-bb3f-30ba13eba3fc None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:01.735102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:01.735714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:01.735984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:01.736251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:01.736896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:01.738811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:01.830115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1263/2531] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:01 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:01.834190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:01.845701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c761e5d-57ab-4c79-823e-84183cc8a8f0 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:01.873002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:01.903529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:01.904082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:01.904535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:01.905171 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:01.905944 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:01.908023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:01.995566 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1269/2532] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:01 2022] POST /identity/v3/users => generated 292 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:32:01.999751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:02.010843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b8a36b-dee5-42ba-8e34-093ba84ca23c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:02.016285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:02.017819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:02.018181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:02.018496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:02.019325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:02.021510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:02.032157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1264/2533] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:02.036665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:02.046782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdc0f1-cd25-4db3-a92a-8e054c343dce admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:02.051456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa14aa-a427-463b-9042-721e434631e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:02.052005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa14aa-a427-463b-9042-721e434631e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:02.052285 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa14aa-a427-463b-9042-721e434631e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:02.052559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa14aa-a427-463b-9042-721e434631e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:02.053244 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa14aa-a427-463b-9042-721e434631e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:02.055370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa14aa-a427-463b-9042-721e434631e7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:02.065967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1270/2534] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:02.072057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:02.082136 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd90def-0c13-4b76-8a8b-fd306478f8de admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:02.086741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:02.087385 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:02.087660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:02.087930 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] PATH_INFO: `/v3/projects/40a18cb6696544aa8538b852b7c4a5bc/users/dca4bcda2c2649959e8c3a0530928650/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:02.102205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40a18cb6696544aa8538b852b7c4a5bc, user_id=dca4bcda2c2649959e8c3a0530928650, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:02.104949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:02.213859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1265/2535] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:02 2022] PUT /identity/v3/projects/40a18cb6696544aa8538b852b7c4a5bc/users/dca4bcda2c2649959e8c3a0530928650/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:02.225269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:02.228873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:02.228873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:02.253687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] MFA Rules not processed for user `dca4bcda2c2649959e8c3a0530928650`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:02.254919 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:02.321404 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1271/2536] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:02.332780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:02.334685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:02.392011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b4585-c883-4115-81bb-3c652c6ba717 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:02.395681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:02.396291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:02.396572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:02.396845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:02.405198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:02.406734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:02.416335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1266/2537] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:09.505579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:09.507103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:09.519494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fb7b0-3eba-45b3-9875-3c4f660fc821 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:09.523082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eb0727-5481-4a17-94c6-df9597485514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:09.523686 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb0727-5481-4a17-94c6-df9597485514 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:09.523983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb0727-5481-4a17-94c6-df9597485514 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:09.524259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eb0727-5481-4a17-94c6-df9597485514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:09.526060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-30eb0727-5481-4a17-94c6-df9597485514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:09.586011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb0727-5481-4a17-94c6-df9597485514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:09.587473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30eb0727-5481-4a17-94c6-df9597485514 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:09.596652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1272/2538] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:12.411639 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:18.961717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:19.028719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612ca3bd-d749-41be-bba0-41940053846a service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:19.033144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:19.033807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:19.034091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:19.034395 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] PATH_INFO: `/v3/users/dca4bcda2c2649959e8c3a0530928650` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:19.035486 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dca4bcda2c2649959e8c3a0530928650)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:19.037398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:19.253444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dca4bcda2c2649959e8c3a0530928650'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:19.325437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dca4bcda2c2649959e8c3a0530928650'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:19.333377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dca4bcda2c2649959e8c3a0530928650'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:19.345246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dca4bcda2c2649959e8c3a0530928650'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:19.348206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dca4bcda2c2649959e8c3a0530928650'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:19.352010 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1267/2539] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:18 2022] DELETE /identity/v3/users/dca4bcda2c2649959e8c3a0530928650 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:19.356348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:19.356869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:19.357156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:19.376353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:19.377618 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:19.412605 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:19.441042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1273/2540] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:19.451399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:19.452730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:19.510197 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19f826d-0f65-4083-a71a-932241b25ba1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:19.513832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad7c377-63ba-4bda-b5af-3b708a9851ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:19.514438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c377-63ba-4bda-b5af-3b708a9851ec service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:19.514716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c377-63ba-4bda-b5af-3b708a9851ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:19.514984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad7c377-63ba-4bda-b5af-3b708a9851ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:19.524399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7c377-63ba-4bda-b5af-3b708a9851ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:19.525847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad7c377-63ba-4bda-b5af-3b708a9851ec service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:19.535310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1268/2541] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:32:19.955088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:19.956606 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:19.968688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88869d-4ca3-407d-bcd2-99e6feb06253 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:19.973910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:19.974567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:19.974848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:19.975287 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] PATH_INFO: `/v3/projects/40a18cb6696544aa8538b852b7c4a5bc` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:19.977050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] RBAC: Authorizing `identity:delete_project(project_id=40a18cb6696544aa8538b852b7c4a5bc)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:19.978524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:20.133288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40a18cb6696544aa8538b852b7c4a5bc', 'request_id': 'req-51e78484-2072-41c2-810a-1a5c6e50759d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:20.138956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40a18cb6696544aa8538b852b7c4a5bc', 'request_id': 'req-51e78484-2072-41c2-810a-1a5c6e50759d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:20.145645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40a18cb6696544aa8538b852b7c4a5bc', 'request_id': 'req-51e78484-2072-41c2-810a-1a5c6e50759d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:20.234965 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] The token cache is being invalidate because project 40a18cb6696544aa8538b852b7c4a5bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:20.235324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:20.236781 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-51e78484-2072-41c2-810a-1a5c6e50759d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:20.238569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1274/2542] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:19 2022] DELETE /identity/v3/projects/40a18cb6696544aa8538b852b7c4a5bc => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:20.243440 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e799cc-b7c7-430c-b350-69a128b2adfd None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.244008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e799cc-b7c7-430c-b350-69a128b2adfd None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.244008 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e799cc-b7c7-430c-b350-69a128b2adfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.269858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e2e799cc-b7c7-430c-b350-69a128b2adfd None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:20.271859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e2e799cc-b7c7-430c-b350-69a128b2adfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:20.297736 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:20.342755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1269/2543] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:20.410351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacceef3-dc5c-4ee0-9a3f-62d93d46bd22 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.410802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacceef3-dc5c-4ee0-9a3f-62d93d46bd22 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.410904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacceef3-dc5c-4ee0-9a3f-62d93d46bd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.432077 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-eacceef3-dc5c-4ee0-9a3f-62d93d46bd22 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:20.433280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-eacceef3-dc5c-4ee0-9a3f-62d93d46bd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:20.441397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1275/2544] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:20.450913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e799cc-b7c7-430c-b350-69a128b2adfd None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:20.461260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e799cc-b7c7-430c-b350-69a128b2adfd None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:20.466070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:20.466710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.466987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.467259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.467944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:32:20.468241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:20.470460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:20.482464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1270/2545] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:32:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:32:20.486576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacceef3-dc5c-4ee0-9a3f-62d93d46bd22 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:20.496151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacceef3-dc5c-4ee0-9a3f-62d93d46bd22 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:20.501075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:20.501679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.502003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.502277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.502939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:20.504832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:20.629040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1276/2546] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:20 2022] POST /identity/v3/projects => generated 359 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:20.633270 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:20.643908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5e2966-5534-4dc6-8732-eacdb3a98181 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:20.701137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:20.701816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.702100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.702373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.703031 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:20.705705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:20.856958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1271/2547] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:20 2022] POST /identity/v3/users => generated 280 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:20.861075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:20.871375 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a9194-757d-4428-8cc2-f0040c526b9e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:20.875842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:20.876948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.877225 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.877500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.878635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:20.880232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:20.890468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1277/2548] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:20.894975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:20.904969 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03156d5-78d3-4dac-8095-772f5506bc49 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:20.909840 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b78ba0b-d1c6-43e3-b963-c7cc8088ae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:20.910500 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ba0b-d1c6-43e3-b963-c7cc8088ae0c admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.910787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ba0b-d1c6-43e3-b963-c7cc8088ae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.911075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b78ba0b-d1c6-43e3-b963-c7cc8088ae0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.911812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ba0b-d1c6-43e3-b963-c7cc8088ae0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:20.913414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b78ba0b-d1c6-43e3-b963-c7cc8088ae0c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:20.924109 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1272/2549] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:20.928121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:20.938076 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f9d73-0b95-4af3-814a-d5f52353ac53 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:20.943510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:20.944156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:20.944436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:20.944710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] PATH_INFO: `/v3/projects/24968d623801411dae684434b9838c4e/users/2ca8f7fd258f40329cae3d243f2a0fcd/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:20.959679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24968d623801411dae684434b9838c4e, user_id=2ca8f7fd258f40329cae3d243f2a0fcd, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:20.962378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:21.079939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1278/2550] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:20 2022] PUT /identity/v3/projects/24968d623801411dae684434b9838c4e/users/2ca8f7fd258f40329cae3d243f2a0fcd/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:21.090191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38094-5871-4698-9566-4a5b25c08154 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:21.090487 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38094-5871-4698-9566-4a5b25c08154 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:21.090760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e38094-5871-4698-9566-4a5b25c08154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:21.119590 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b7e38094-5871-4698-9566-4a5b25c08154 None None] MFA Rules not processed for user `2ca8f7fd258f40329cae3d243f2a0fcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:21.120788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b7e38094-5871-4698-9566-4a5b25c08154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:21.190783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1273/2551] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:21 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:21.223766 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:21.225546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:21.282399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2501884f-4c01-41f2-b759-57c6f53e2232 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:21.286118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8263a3-043d-40f8-abd7-cad8123e43a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:21.286728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8263a3-043d-40f8-abd7-cad8123e43a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:21.287014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8263a3-043d-40f8-abd7-cad8123e43a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:21.287286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8263a3-043d-40f8-abd7-cad8123e43a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:21.295573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8263a3-043d-40f8-abd7-cad8123e43a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:21.296999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8263a3-043d-40f8-abd7-cad8123e43a4 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:21.301113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:21.306999 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1279/2552] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:21 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:21.323418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e38094-5871-4698-9566-4a5b25c08154 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:21.342548 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:21.385745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e38094-5871-4698-9566-4a5b25c08154 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:21.390710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:21.391356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:21.391661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:21.391941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] PATH_INFO: `/v3/users/2ca8f7fd258f40329cae3d243f2a0fcd` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:21.393200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca8f7fd258f40329cae3d243f2a0fcd)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:21.395146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:21.584526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f3624-6444-43c6-99b0-276fa3d7dc69 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:21.585067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f3624-6444-43c6-99b0-276fa3d7dc69 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:21.585067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f3624-6444-43c6-99b0-276fa3d7dc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:21.605888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-df3f3624-6444-43c6-99b0-276fa3d7dc69 None None] MFA Rules not processed for user `0104b0fa57ac4ea280ffd3fc540e6358`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:21.607091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-df3f3624-6444-43c6-99b0-276fa3d7dc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:21.625256 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca8f7fd258f40329cae3d243f2a0fcd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:21.667659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1280/2553] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:21.759793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca8f7fd258f40329cae3d243f2a0fcd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:21.767928 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca8f7fd258f40329cae3d243f2a0fcd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:21.780670 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca8f7fd258f40329cae3d243f2a0fcd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:21.781371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca8f7fd258f40329cae3d243f2a0fcd'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:21.788299 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1274/2554] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:21 2022] DELETE /identity/v3/users/2ca8f7fd258f40329cae3d243f2a0fcd => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:21.792778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:21.793076 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:21.793353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:21.812749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:21.814028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:21.876616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1281/2555] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:21.886420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:21.887954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:21.948739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213f9af9-b416-4550-ac24-03a422ebe5ce admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:21.952336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66abcfe9-7e18-4386-a89e-5b6ef4196a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:21.952945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abcfe9-7e18-4386-a89e-5b6ef4196a06 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:21.953247 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abcfe9-7e18-4386-a89e-5b6ef4196a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:21.959698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66abcfe9-7e18-4386-a89e-5b6ef4196a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:21.964694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abcfe9-7e18-4386-a89e-5b6ef4196a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:21.966387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66abcfe9-7e18-4386-a89e-5b6ef4196a06 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:21.977508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1275/2556] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:22.465656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:22.466384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:22.478848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc042e38-90ef-4244-9bc1-6ee584abde74 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:22.483734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:22.484416 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:22.484702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:22.484980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] PATH_INFO: `/v3/projects/24968d623801411dae684434b9838c4e` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:22.486249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24968d623801411dae684434b9838c4e)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:22.489269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:22.598804 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24968d623801411dae684434b9838c4e', 'request_id': 'req-2e19f2c5-7eab-4956-9ed2-42372ff473e0'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:22.608156 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24968d623801411dae684434b9838c4e', 'request_id': 'req-2e19f2c5-7eab-4956-9ed2-42372ff473e0'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:22.623732 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24968d623801411dae684434b9838c4e', 'request_id': 'req-2e19f2c5-7eab-4956-9ed2-42372ff473e0'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:22.760121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] The token cache is being invalidate because project 24968d623801411dae684434b9838c4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:22.760417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:22.761075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e19f2c5-7eab-4956-9ed2-42372ff473e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:22.762867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1282/2557] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:22 2022] DELETE /identity/v3/projects/24968d623801411dae684434b9838c4e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:22.767659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893cf4-707b-44e7-b1b3-161ec04d0974 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:22.768094 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893cf4-707b-44e7-b1b3-161ec04d0974 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:22.768531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10893cf4-707b-44e7-b1b3-161ec04d0974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:22.792858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-10893cf4-707b-44e7-b1b3-161ec04d0974 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:22.794102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-10893cf4-707b-44e7-b1b3-161ec04d0974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:22.829326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:22.853889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1276/2558] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:22.862483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af510-de74-4988-a603-0956b67ff9fc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:22.862768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af510-de74-4988-a603-0956b67ff9fc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:22.863070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af510-de74-4988-a603-0956b67ff9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:22.883386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6b2af510-de74-4988-a603-0956b67ff9fc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:22.884579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6b2af510-de74-4988-a603-0956b67ff9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:22.900492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1283/2559] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:22.904640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893cf4-707b-44e7-b1b3-161ec04d0974 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:22.915320 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10893cf4-707b-44e7-b1b3-161ec04d0974 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:22.921073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:22.921964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:22.922327 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:22.923117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:22.923903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:32:22.924198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:22.925827 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:22.941968 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1277/2560] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:32:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:32:22.946436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af510-de74-4988-a603-0956b67ff9fc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:22.956460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af510-de74-4988-a603-0956b67ff9fc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:22.961506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:22.962202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:22.962485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:22.962757 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:22.963467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:22.965386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:23.041463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:23.048942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1284/2561] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:22 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:23.054868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:23.065096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656caa3f-bce8-4ab4-9412-8f06ecb7cc79 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:23.123477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:23.124431 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:23.124909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:23.125374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:23.126126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:23.129267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:23.211469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1278/2562] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:23 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:23.215811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:23.227019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520128-559a-4f42-8f8c-418ff9dfd7d8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:23.231729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:23.232340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:23.232614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:23.232882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:23.233563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:23.235233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:23.246315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1285/2563] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:23.251489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:23.263435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bf49a-9b1d-463c-8a25-6327641cc96b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:23.268157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783be44-28e9-4133-b4d8-b8b20f8244a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:23.268761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783be44-28e9-4133-b4d8-b8b20f8244a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:23.269043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783be44-28e9-4133-b4d8-b8b20f8244a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:23.269314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783be44-28e9-4133-b4d8-b8b20f8244a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:23.270072 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783be44-28e9-4133-b4d8-b8b20f8244a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:23.271707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783be44-28e9-4133-b4d8-b8b20f8244a9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:23.289686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1279/2564] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:23 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:23.293187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:23.303895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068ceca2-6583-4ab0-929c-2ff7d56c0741 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:23.308744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:23.309394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:23.309677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:23.309993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] PATH_INFO: `/v3/projects/7686d3a12c314a2bb991371d1cd758ea/users/ab973fe6c06d407b9f6b9d9bc5d96cc8/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:23.325003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7686d3a12c314a2bb991371d1cd758ea, user_id=ab973fe6c06d407b9f6b9d9bc5d96cc8, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:23.327722 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:23.439127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1286/2565] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:23 2022] PUT /identity/v3/projects/7686d3a12c314a2bb991371d1cd758ea/users/ab973fe6c06d407b9f6b9d9bc5d96cc8/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:23.451036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe556b-4cec-46da-a2d8-cc984cda5dd8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:23.451209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe556b-4cec-46da-a2d8-cc984cda5dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:23.451494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfe556b-4cec-46da-a2d8-cc984cda5dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:23.480356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6bfe556b-4cec-46da-a2d8-cc984cda5dd8 None None] MFA Rules not processed for user `ab973fe6c06d407b9f6b9d9bc5d96cc8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:23.481576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6bfe556b-4cec-46da-a2d8-cc984cda5dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:23.546946 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1280/2566] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:23.551358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:23.614801 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7095c-4941-481f-987b-3545d32b4a7a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:23.619592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:23.620205 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:23.620494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:23.620768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:23.621426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:23.623369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:23.755152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1287/2567] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:23 2022] POST /identity/v3/projects => generated 383 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:32:23.759251 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe556b-4cec-46da-a2d8-cc984cda5dd8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:23.770404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfe556b-4cec-46da-a2d8-cc984cda5dd8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:23.802246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:23.827023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:23.827678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:23.827945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:23.828215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:23.828929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:23.831372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:24.060113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1281/2568] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:23 2022] POST /identity/v3/users => generated 292 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:24.060835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.072291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb29e2b-b930-47ea-95f9-f52a080e77d3 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:24.076892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:24.077532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.077848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.078130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.078826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:24.081024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:24.092549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1288/2569] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:24.096507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.120204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de32257-f25e-4b2e-abc5-7eaf60cfc5b7 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:24.124896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0434494e-8a96-4c3b-aab4-a7bbf982b8ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:24.125551 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434494e-8a96-4c3b-aab4-a7bbf982b8ad admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.126427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434494e-8a96-4c3b-aab4-a7bbf982b8ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.126850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434494e-8a96-4c3b-aab4-a7bbf982b8ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.127539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434494e-8a96-4c3b-aab4-a7bbf982b8ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:24.129154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0434494e-8a96-4c3b-aab4-a7bbf982b8ad admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:24.141207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1282/2570] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:24.145370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.155917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6567423-8e67-424f-878b-2781362e7864 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:24.160723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:24.161424 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.161706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.162021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] PATH_INFO: `/v3/projects/08c7eae29f434e548266aaaea3357000/users/871a39995b874bae8f72bbbf77030d28/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.180065 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08c7eae29f434e548266aaaea3357000, user_id=871a39995b874bae8f72bbbf77030d28, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:24.183269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:24.299295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1289/2571] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:24 2022] PUT /identity/v3/projects/08c7eae29f434e548266aaaea3357000/users/871a39995b874bae8f72bbbf77030d28/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:24.309184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f101a38-7893-4945-a29b-b3556bdf86d6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.309470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f101a38-7893-4945-a29b-b3556bdf86d6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.309745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f101a38-7893-4945-a29b-b3556bdf86d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.343177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8f101a38-7893-4945-a29b-b3556bdf86d6 None None] MFA Rules not processed for user `871a39995b874bae8f72bbbf77030d28`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:24.344664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8f101a38-7893-4945-a29b-b3556bdf86d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:24.432017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1283/2572] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:24.436633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.521148 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7567028f-c8b2-4ec1-97a9-ba9402b84fd1 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:24.526206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:24.527014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.527464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.527894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.530035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:24.534096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:24.640032 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:24.647557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1290/2573] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:24 2022] POST /identity/v3/projects => generated 385 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:32:24.651802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f101a38-7893-4945-a29b-b3556bdf86d6 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.664358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f101a38-7893-4945-a29b-b3556bdf86d6 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:24.728721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:24.729453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.729843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.730187 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.730956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:24.732963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:24.847052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1284/2574] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:24 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:24.851309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.875379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcfefaa-2d86-42a2-ae9d-1ad8739fa10e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:24.880784 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:24.889282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.889282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.889282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.889282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:24.889282 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:24.901642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1291/2575] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:24.902782 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.915117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec88e5-1750-4367-a183-5da7b3d236eb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:24.920154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:24.925792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:24.939277 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:24.939982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:24.940268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:24.941334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] PATH_INFO: `/v3/projects/f86514459f9b4a3ea801ac310a45fe32/users/f20ce44c24b8444297c4d1ec2143157b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:24.977366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86514459f9b4a3ea801ac310a45fe32, user_id=f20ce44c24b8444297c4d1ec2143157b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:24.986828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:25.070055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1285/2576] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:24 2022] PUT /identity/v3/projects/f86514459f9b4a3ea801ac310a45fe32/users/f20ce44c24b8444297c4d1ec2143157b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:25.074640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:25.095050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:25.143050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7374cbcb-f5af-4b3a-bcb9-1e6c80aac88d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:25.195734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abca5ac2-e39e-41a8-8f7b-b12904297c0e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:25.201549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:25.203661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:25.203661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:25.203661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:25.203661 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:25.206231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:25.221168 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1286/2577] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:25.225038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:25.237563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484787c-b702-45d9-8b65-875d8d58befe admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:25.238368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:25.238964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:25.244155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:25.244155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:25.244155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:25.244562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82ee000-5b40-4943-bb3c-48e3ce7d4ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:25.244562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee000-5b40-4943-bb3c-48e3ce7d4ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:25.244562 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee000-5b40-4943-bb3c-48e3ce7d4ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:25.244846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82ee000-5b40-4943-bb3c-48e3ce7d4ba0 admin admin] PATH_INFO: `/v3/projects/f86514459f9b4a3ea801ac310a45fe32/users/f20ce44c24b8444297c4d1ec2143157b/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:25.247174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee000-5b40-4943-bb3c-48e3ce7d4ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f86514459f9b4a3ea801ac310a45fe32, user_id=f20ce44c24b8444297c4d1ec2143157b, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:25.251572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82ee000-5b40-4943-bb3c-48e3ce7d4ba0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:25.276102 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1287/2578] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:25 2022] PUT /identity/v3/projects/f86514459f9b4a3ea801ac310a45fe32/users/f20ce44c24b8444297c4d1ec2143157b/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:25.287936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44149a9-20da-4652-9880-837c5b2caad0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:25.288245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44149a9-20da-4652-9880-837c5b2caad0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:25.288528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44149a9-20da-4652-9880-837c5b2caad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:25.333601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a44149a9-20da-4652-9880-837c5b2caad0 None None] MFA Rules not processed for user `f20ce44c24b8444297c4d1ec2143157b`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:25.334995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a44149a9-20da-4652-9880-837c5b2caad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:25.352579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:25.358682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:25.361097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:25.374843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1292/2579] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:25.467729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:25.470401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:25.471059 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1288/2580] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:25 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:25.551872 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc161c6-0f18-46b0-b673-01c7081606bf service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:25.613705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:25.614698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:25.615632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:25.615632 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:25.700875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:25.702500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:25.716215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1293/2581] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:32:31.084119 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44149a9-20da-4652-9880-837c5b2caad0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:31.094195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44149a9-20da-4652-9880-837c5b2caad0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:31.101821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:31.101821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:31.101821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:31.102211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:31.165624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:31.167019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:31.178464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1289/2582] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:31 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:33.130529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:33.139247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75d84d2-28b8-4537-8749-176c0ad8cb24 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:33.143017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:33.143622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:33.143899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:33.144170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:33.153529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:33.155061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:33.164769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1294/2583] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:33.410942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:33.412664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:33.435538 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:33.512793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8184c3-6c64-4752-8ca4-2d895dc1ebb6 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:33.518373 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:33.518911 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:33.519196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:33.519472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:33.521378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:33.533838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:33.535457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:33.545412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1290/2584] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:36.053214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:36.055687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:36.134735 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a065b58-0a72-49e3-9315-ff57d01eb5c1 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:36.138565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5889fc74-c9a5-41e2-b88c-59282040e05f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:36.139184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889fc74-c9a5-41e2-b88c-59282040e05f service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:36.139494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889fc74-c9a5-41e2-b88c-59282040e05f service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:36.139787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5889fc74-c9a5-41e2-b88c-59282040e05f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:36.144093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5889fc74-c9a5-41e2-b88c-59282040e05f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:36.151113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:36.212151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889fc74-c9a5-41e2-b88c-59282040e05f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:36.213678 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5889fc74-c9a5-41e2-b88c-59282040e05f service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:36.223883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1295/2585] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:36.291177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:36.292636 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:36.309945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85be57a-49f1-4966-a64b-6f91f75f6b19 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:36.325257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:36.326023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:36.326513 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:36.326796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] PATH_INFO: `/v3/users/ae29177f4503447ab862d224e1822898` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:36.329338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae29177f4503447ab862d224e1822898)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:36.331282 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:36.631783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae29177f4503447ab862d224e1822898'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:36.736843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae29177f4503447ab862d224e1822898'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:36.744583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae29177f4503447ab862d224e1822898'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:36.757334 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae29177f4503447ab862d224e1822898'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:36.758225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae29177f4503447ab862d224e1822898'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:36.767483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1291/2586] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:36 2022] DELETE /identity/v3/users/ae29177f4503447ab862d224e1822898 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:36.769002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:36.769290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:36.769565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:36.791027 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:36.793255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:36.864609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1296/2587] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:36.874877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:36.876571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:36.939130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01cace6-41b2-4e98-82c4-19955d1c0f1b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:36.949390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:36.950080 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:36.950365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:36.950640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:36.961873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:36.963314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:36.969691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:36.981929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1292/2588] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:37.451977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:37.454547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:37.482162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3f4ad-4e78-430e-9e53-6fba9d48e113 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:37.490099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:37.490884 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:37.491365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:37.492146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] PATH_INFO: `/v3/projects/9f466b7653224c968270251cae9f646c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:37.494928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f466b7653224c968270251cae9f646c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:37.499460 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:37.651435 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f466b7653224c968270251cae9f646c', 'request_id': 'req-ebfd65db-e745-42cf-af5f-30fe22e7e82d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:37.660956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f466b7653224c968270251cae9f646c', 'request_id': 'req-ebfd65db-e745-42cf-af5f-30fe22e7e82d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:37.668062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f466b7653224c968270251cae9f646c', 'request_id': 'req-ebfd65db-e745-42cf-af5f-30fe22e7e82d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:37.752852 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] The token cache is being invalidate because project 9f466b7653224c968270251cae9f646c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:37.753145 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:37.753810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:37.755880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1297/2589] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:37 2022] DELETE /identity/v3/projects/9f466b7653224c968270251cae9f646c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:37.759965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:37.770104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07498d41-2cb9-477c-9e8b-7e725d01ec09 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:37.830013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:37.830665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:37.830944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:37.831219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] PATH_INFO: `/v3/users/9f272c86023445988ccd3d6dee8773de` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:37.832381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f272c86023445988ccd3d6dee8773de)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:37.834350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:38.039841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f272c86023445988ccd3d6dee8773de'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.081182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:38.082972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:38.096657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd65db-e745-42cf-af5f-30fe22e7e82d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:38.105450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:38.106159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:38.106446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:38.106790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] PATH_INFO: `/v3/users/ab973fe6c06d407b9f6b9d9bc5d96cc8` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:38.107996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab973fe6c06d407b9f6b9d9bc5d96cc8)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:38.110931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:38.135648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f272c86023445988ccd3d6dee8773de'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.142438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:38.144931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f272c86023445988ccd3d6dee8773de'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.161241 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f272c86023445988ccd3d6dee8773de'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.163536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6051fd15-0fcc-41b2-9de6-d824ea541780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f272c86023445988ccd3d6dee8773de'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.173699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1293/2590] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:37 2022] DELETE /identity/v3/users/9f272c86023445988ccd3d6dee8773de => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:38.431723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab973fe6c06d407b9f6b9d9bc5d96cc8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.432471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab973fe6c06d407b9f6b9d9bc5d96cc8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.446779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab973fe6c06d407b9f6b9d9bc5d96cc8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.447522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab973fe6c06d407b9f6b9d9bc5d96cc8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.587480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab973fe6c06d407b9f6b9d9bc5d96cc8'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:38.608509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1298/2591] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:38 2022] DELETE /identity/v3/users/ab973fe6c06d407b9f6b9d9bc5d96cc8 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:38.612949 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:38.613296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:38.613573 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:38.632484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:38.633690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:38.707691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1294/2592] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:38.718232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:38.720301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:38.793734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373336c-e932-4d35-9db3-f69f6c69eb6d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:38.799221 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:38.801166 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:38.801309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71eb231-8693-4678-827c-613d69c5a298 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:38.802044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb231-8693-4678-827c-613d69c5a298 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:38.803097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb231-8693-4678-827c-613d69c5a298 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:38.803471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71eb231-8693-4678-827c-613d69c5a298 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:38.822035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71eb231-8693-4678-827c-613d69c5a298 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:38.824394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71eb231-8693-4678-827c-613d69c5a298 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:38.836715 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791ac2a8-0aa1-46fc-a973-1fe2c57a8e76 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:38.839838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1299/2593] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:38.842830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:38.843532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:38.843833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:38.844181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] PATH_INFO: `/v3/projects/60d8030ba3b54587b131213f7ac66932` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:38.845366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d8030ba3b54587b131213f7ac66932)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:38.847357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:38.865267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:39.022494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d8030ba3b54587b131213f7ac66932', 'request_id': 'req-6c9fe29b-18c3-49d6-9fc3-c4939263c493'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.096149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d8030ba3b54587b131213f7ac66932', 'request_id': 'req-6c9fe29b-18c3-49d6-9fc3-c4939263c493'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.126101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d8030ba3b54587b131213f7ac66932', 'request_id': 'req-6c9fe29b-18c3-49d6-9fc3-c4939263c493'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.142369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] The token cache is being invalidate because project 60d8030ba3b54587b131213f7ac66932 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:39.142517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.143124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c9fe29b-18c3-49d6-9fc3-c4939263c493 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.148112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1295/2594] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:38 2022] DELETE /identity/v3/projects/60d8030ba3b54587b131213f7ac66932 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:39.150289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048c9de-83f6-4932-9924-124e2efd0557 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.150587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048c9de-83f6-4932-9924-124e2efd0557 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.155322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a048c9de-83f6-4932-9924-124e2efd0557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.175041 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a048c9de-83f6-4932-9924-124e2efd0557 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:39.176276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a048c9de-83f6-4932-9924-124e2efd0557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:39.245374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1300/2595] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:39.247219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6eda9-5c2c-418b-b3e0-e3adf51fd6ef None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.247581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6eda9-5c2c-418b-b3e0-e3adf51fd6ef None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.248218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6eda9-5c2c-418b-b3e0-e3adf51fd6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.269730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-2af6eda9-5c2c-418b-b3e0-e3adf51fd6ef None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:39.271701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2af6eda9-5c2c-418b-b3e0-e3adf51fd6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:39.281722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1296/2596] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:39.286562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048c9de-83f6-4932-9924-124e2efd0557 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.297591 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a048c9de-83f6-4932-9924-124e2efd0557 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:39.303326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:39.304023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.304315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.304592 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.305310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:32:39.305639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:39.307304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:39.321443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1301/2597] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:32:39.326047 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6eda9-5c2c-418b-b3e0-e3adf51fd6ef None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.336330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6eda9-5c2c-418b-b3e0-e3adf51fd6ef None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:39.341465 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:39.342137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.342413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.342720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.343407 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:39.345360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:39.456791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1297/2598] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:39 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:39.461480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.477565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae912bcb-318f-4ee3-84e4-fc94e5217788 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:39.512647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:39.551051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:39.551685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.551963 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.552237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.552899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:39.554858 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:39.662235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.664853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:39.672055 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1302/2599] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:39 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:39.677528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.689215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319ed9d4-3fb6-4142-8f60-ead8c519329c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:39.690850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc25e88-bfb8-4045-ab5e-20b0ba1d3de5 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:39.694544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:39.695170 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.695446 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.695993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.697347 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:39.697814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:39.698564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.698942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.699455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] PATH_INFO: `/v3/projects/7686d3a12c314a2bb991371d1cd758ea` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.700008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:39.701041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7686d3a12c314a2bb991371d1cd758ea)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:39.704641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:39.713729 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1303/2600] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:39.729386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.743300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d81cc4-b40a-4e37-9609-b9b42ad8e544 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:39.751376 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:39.752387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.752879 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.753312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.754072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:39.756009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:39.767797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1304/2601] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:39.772044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.783221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33641289-153f-4e0f-94b4-0b156ad16517 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:39.788816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e7153d-3169-4cde-a746-34d3b8c7bad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:39.789542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7153d-3169-4cde-a746-34d3b8c7bad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.789885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7153d-3169-4cde-a746-34d3b8c7bad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.790166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e7153d-3169-4cde-a746-34d3b8c7bad9 admin admin] PATH_INFO: `/v3/projects/5365f4b7238446809aeba9cb48e4ff70/users/1939756a3b0e482c895e743dd3a5977b/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.807377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7153d-3169-4cde-a746-34d3b8c7bad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5365f4b7238446809aeba9cb48e4ff70, user_id=1939756a3b0e482c895e743dd3a5977b, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:39.810130 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e7153d-3169-4cde-a746-34d3b8c7bad9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:39.826367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7686d3a12c314a2bb991371d1cd758ea', 'request_id': 'req-7bcfc3b2-5993-45d8-baee-2be9353ec709'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.901347 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1305/2602] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:39 2022] PUT /identity/v3/projects/5365f4b7238446809aeba9cb48e4ff70/users/1939756a3b0e482c895e743dd3a5977b/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:32:39.915643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:39.915928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:39.916387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:39.919058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7686d3a12c314a2bb991371d1cd758ea', 'request_id': 'req-7bcfc3b2-5993-45d8-baee-2be9353ec709'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.929600 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7686d3a12c314a2bb991371d1cd758ea', 'request_id': 'req-7bcfc3b2-5993-45d8-baee-2be9353ec709'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.947460 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] The token cache is being invalidate because project 7686d3a12c314a2bb991371d1cd758ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:39.947917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.948865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:39.954697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1298/2603] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:39 2022] DELETE /identity/v3/projects/7686d3a12c314a2bb991371d1cd758ea => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:39.955837 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:39.957494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:39.971776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] MFA Rules not processed for user `1939756a3b0e482c895e743dd3a5977b`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:39.973022 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:40.044255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:40.049149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcfc3b2-5993-45d8-baee-2be9353ec709 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:40.065389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1306/2604] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:40.066430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:40.068568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:40.139223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:40.140224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.140524 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.141677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] PATH_INFO: `/v3/users/871a39995b874bae8f72bbbf77030d28` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.143025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] RBAC: Authorizing `identity:delete_user(user_id=871a39995b874bae8f72bbbf77030d28)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:40.144984 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:40.198731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997e117b-fb3c-4be3-a5ce-b7dac698b9bc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:40.204017 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:40.204665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.204947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.205223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.205945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:40.207874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:40.369725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1307/2605] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:40 2022] POST /identity/v3/projects => generated 387 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:40.370836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:40.406495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '871a39995b874bae8f72bbbf77030d28'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:40.443673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fec9fe-c911-4064-a835-055dd6812094 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:40.448536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:40.449295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.449528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.449829 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.450524 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:40.452463 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:40.512414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '871a39995b874bae8f72bbbf77030d28'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:40.520758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '871a39995b874bae8f72bbbf77030d28'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:40.534203 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '871a39995b874bae8f72bbbf77030d28'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:40.535137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '871a39995b874bae8f72bbbf77030d28'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:40.542626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1299/2606] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:39 2022] DELETE /identity/v3/users/871a39995b874bae8f72bbbf77030d28 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:40.542748 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1308/2607] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:40 2022] POST /identity/v3/users => generated 300 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:32:40.546612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:40.548867 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:40.607830 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:40.640457 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c130d82-c691-451e-a28f-cdb20caf3403 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:40.645737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:40.646396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.646681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.646961 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.647677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:40.649374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:40.659919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1300/2608] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:32:40.664191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:40.674237 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b711d0-7747-4e92-bc8d-cbd5c8298a05 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:40.679197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:40.679864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.680206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.680486 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] PATH_INFO: `/v3/projects/3565435243424acbb5e0ac8600bbace6/users/690df4f937ba4ca1a7ae8bf0829a56c9/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.696035 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3565435243424acbb5e0ac8600bbace6, user_id=690df4f937ba4ca1a7ae8bf0829a56c9, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:40.698779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:40.784320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1309/2609] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:40 2022] PUT /identity/v3/projects/3565435243424acbb5e0ac8600bbace6/users/690df4f937ba4ca1a7ae8bf0829a56c9/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:40.788386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:40.799396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29958607-0edf-4123-81e0-6c006e8ec14e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:40.869483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6fcc-1013-4fbc-ad77-86f7bd6da476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:40.870859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6fcc-1013-4fbc-ad77-86f7bd6da476 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.871312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6fcc-1013-4fbc-ad77-86f7bd6da476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.871734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6fcc-1013-4fbc-ad77-86f7bd6da476 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.872621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6fcc-1013-4fbc-ad77-86f7bd6da476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:40.874435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6fcc-1013-4fbc-ad77-86f7bd6da476 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:40.885601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1301/2610] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:32:40.889941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:40.901822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2761dc17-7190-4685-ac92-31b9b29a511d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:40.910221 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:40.911490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.911825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.912062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] PATH_INFO: `/v3/projects/3565435243424acbb5e0ac8600bbace6/users/690df4f937ba4ca1a7ae8bf0829a56c9/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.916133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3565435243424acbb5e0ac8600bbace6, user_id=690df4f937ba4ca1a7ae8bf0829a56c9, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:40.918083 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:40.931620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1310/2611] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:40 2022] PUT /identity/v3/projects/3565435243424acbb5e0ac8600bbace6/users/690df4f937ba4ca1a7ae8bf0829a56c9/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:40.942158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:40.942668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:40.943223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:40.947553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:40.981816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] MFA Rules not processed for user `690df4f937ba4ca1a7ae8bf0829a56c9`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:40.983232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:41.075259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1302/2612] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:40 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:41.089060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:41.091279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:41.174969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebfef5-1ac8-4b5e-9d9c-d7c2dc5f137f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:41.178917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:41.180025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:41.180457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:41.180940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:41.193033 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:41.194630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:41.206359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1311/2613] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:32:41.244392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:41.245955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:41.330066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce30847-c4af-44ad-99c0-9d2e66f4ef24 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:41.341316 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:41.343075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:41.343435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:41.343804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] PATH_INFO: `/v3/projects/08c7eae29f434e548266aaaea3357000` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:41.345490 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08c7eae29f434e548266aaaea3357000)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:41.347658 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:41.475150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08c7eae29f434e548266aaaea3357000', 'request_id': 'req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.581684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08c7eae29f434e548266aaaea3357000', 'request_id': 'req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.588157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08c7eae29f434e548266aaaea3357000', 'request_id': 'req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.602369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] The token cache is being invalidate because project 08c7eae29f434e548266aaaea3357000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:41.602655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.603441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.605055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1303/2614] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:41 2022] DELETE /identity/v3/projects/08c7eae29f434e548266aaaea3357000 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:41.609188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:41.620559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9383cf5c-1cd1-4469-bf5c-e77d386fbb30 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:41.664031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:41.681948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:41.682652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:41.682930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:41.683193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] PATH_INFO: `/v3/users/f20ce44c24b8444297c4d1ec2143157b` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:41.684365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f20ce44c24b8444297c4d1ec2143157b)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:41.686353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:41.963074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f20ce44c24b8444297c4d1ec2143157b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.963765 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f20ce44c24b8444297c4d1ec2143157b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.980257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f20ce44c24b8444297c4d1ec2143157b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:41.981422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f20ce44c24b8444297c4d1ec2143157b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:42.049359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f20ce44c24b8444297c4d1ec2143157b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:42.056602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:42.061897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1312/2615] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:41 2022] DELETE /identity/v3/users/f20ce44c24b8444297c4d1ec2143157b => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:32:42.571336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:42.574276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:42.588022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df169cd7-6cdc-4bae-98ad-00d9b0bc9054 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:42.626129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:42.627917 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:42.680937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:42.682401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:42.682401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:42.682401 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] PATH_INFO: `/v3/projects/f86514459f9b4a3ea801ac310a45fe32` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:42.683595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f86514459f9b4a3ea801ac310a45fe32)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:42.685529 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:42.743646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bc759e-0665-4380-9121-f1ae7047976d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:42.751981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:42.753279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:42.753988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:42.754496 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] PATH_INFO: `/v3/users/1939756a3b0e482c895e743dd3a5977b` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:42.756120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1939756a3b0e482c895e743dd3a5977b)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:42.758412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:42.832534 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f86514459f9b4a3ea801ac310a45fe32', 'request_id': 'req-c7953ff9-133a-4a36-8ab6-d759461dc611'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:42.906992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f86514459f9b4a3ea801ac310a45fe32', 'request_id': 'req-c7953ff9-133a-4a36-8ab6-d759461dc611'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:42.917800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f86514459f9b4a3ea801ac310a45fe32', 'request_id': 'req-c7953ff9-133a-4a36-8ab6-d759461dc611'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:42.930823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] The token cache is being invalidate because project f86514459f9b4a3ea801ac310a45fe32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:42.931165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:42.931864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-c7953ff9-133a-4a36-8ab6-d759461dc611 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:42.939892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1304/2616] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:42 2022] DELETE /identity/v3/projects/f86514459f9b4a3ea801ac310a45fe32 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:42.947127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba61b23-f234-4db5-a856-929f9876ebcc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:42.947127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba61b23-f234-4db5-a856-929f9876ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:42.947127 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba61b23-f234-4db5-a856-929f9876ebcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:42.966932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-eba61b23-f234-4db5-a856-929f9876ebcc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:42.969032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-eba61b23-f234-4db5-a856-929f9876ebcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:43.003073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1939756a3b0e482c895e743dd3a5977b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:43.003856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1939756a3b0e482c895e743dd3a5977b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:43.017200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:43.019215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1939756a3b0e482c895e743dd3a5977b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:43.020039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1939756a3b0e482c895e743dd3a5977b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:43.056044 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1305/2617] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:43.065576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2ff08-cb99-4c04-b249-08bca6be5e5e None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.066253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2ff08-cb99-4c04-b249-08bca6be5e5e None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.066253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a2ff08-cb99-4c04-b249-08bca6be5e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.086510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a6a2ff08-cb99-4c04-b249-08bca6be5e5e None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:43.087685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a6a2ff08-cb99-4c04-b249-08bca6be5e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:43.097356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1306/2618] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:43.101937 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2ff08-cb99-4c04-b249-08bca6be5e5e None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.118843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-160a8163-6ad3-495d-93a3-0ba37ba6442f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1939756a3b0e482c895e743dd3a5977b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:43.119295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:43.123338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a2ff08-cb99-4c04-b249-08bca6be5e5e None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.129912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.130877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.130877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.131107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.131872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:32:43.132184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.134101 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.145711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1313/2619] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:42 2022] DELETE /identity/v3/users/1939756a3b0e482c895e743dd3a5977b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:43.149180 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1307/2620] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:32:43.150283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.150850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.151298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.154040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.164896 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4638b29-0e3a-4668-a75b-ccfeef998c13 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.179283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:43.182326 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:43.229805 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.230714 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.231133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.231498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.232231 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.235370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.264839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1314/2621] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:43.275643 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.276515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:43.308336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1308/2622] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:43 2022] POST /identity/v3/projects => generated 381 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:43.313721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.354761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761f9c1-cee0-40e9-81e4-99769c04ed92 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.383683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82128499-4893-4654-98a7-bb739cdbd2a3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.389420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.390084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.390392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.390675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.391693 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.393794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.431898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.437113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.437113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.437113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.447222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.448790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.459935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1315/2623] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:32:43.507545 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1309/2624] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:43 2022] POST /identity/v3/users => generated 291 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:43.511989 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.522406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c981cc8c-c635-4b7d-a3e1-168d8c4f84b6 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.527104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.527710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.527991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.528270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.528981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.530627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.541796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1316/2625] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:43.549631 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.559855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b440360-5de0-41bd-b65d-7817c94bf511 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.564624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277a5c7-c56f-43bb-a42a-516d48144430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.565234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a5c7-c56f-43bb-a42a-516d48144430 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.565518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a5c7-c56f-43bb-a42a-516d48144430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.565817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277a5c7-c56f-43bb-a42a-516d48144430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.566510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277a5c7-c56f-43bb-a42a-516d48144430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.568348 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3277a5c7-c56f-43bb-a42a-516d48144430 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.578820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1310/2626] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:43.582933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.592880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de12f735-fc41-4bf6-b4be-55e66ee48ce7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.598445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.599119 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.599398 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.599697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] PATH_INFO: `/v3/projects/616eb300f24646b8bfcec7a1c18f5b6e/users/724b68c33d1c49738f2bc1ad4291e496/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.620701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] RBAC: Authorizing `identity:create_grant(project_id=616eb300f24646b8bfcec7a1c18f5b6e, user_id=724b68c33d1c49738f2bc1ad4291e496, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.620701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.759023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1317/2627] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:43 2022] PUT /identity/v3/projects/616eb300f24646b8bfcec7a1c18f5b6e/users/724b68c33d1c49738f2bc1ad4291e496/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:43.765111 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.765968 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.766272 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.823497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:43.824781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:43.896033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1311/2628] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:43.906797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:43.967969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd27fed3-737c-4c39-beb4-214ea6179164 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:43.972194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:43.973203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:43.973525 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:43.973878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:43.983770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:43.985568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:43.995898 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1318/2629] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:44.055543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:44.055543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:44.077350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5229c-7008-464e-88c5-21b973ef7db4 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:44.092624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:44.093733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:44.094290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:44.094802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] PATH_INFO: `/v3/projects/5365f4b7238446809aeba9cb48e4ff70` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:44.096366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5365f4b7238446809aeba9cb48e4ff70)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:44.099340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:44.314063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5365f4b7238446809aeba9cb48e4ff70', 'request_id': 'req-90761cd4-1029-4325-b634-d74f4d930152'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.462205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5365f4b7238446809aeba9cb48e4ff70', 'request_id': 'req-90761cd4-1029-4325-b634-d74f4d930152'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.479677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5365f4b7238446809aeba9cb48e4ff70', 'request_id': 'req-90761cd4-1029-4325-b634-d74f4d930152'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.503489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] The token cache is being invalidate because project 5365f4b7238446809aeba9cb48e4ff70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:44.503780 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.504527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.507377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1312/2630] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:44 2022] DELETE /identity/v3/projects/5365f4b7238446809aeba9cb48e4ff70 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:44.511233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:44.536589 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82283eb-281a-4969-8cb3-f8c02ba642da service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:44.650695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:44.653631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:44.654640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:44.655271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:44.655936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] PATH_INFO: `/v3/users/690df4f937ba4ca1a7ae8bf0829a56c9` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:44.658019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=690df4f937ba4ca1a7ae8bf0829a56c9)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:44.660711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:44.924560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:44.984396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '690df4f937ba4ca1a7ae8bf0829a56c9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.985149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '690df4f937ba4ca1a7ae8bf0829a56c9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.998012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '690df4f937ba4ca1a7ae8bf0829a56c9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:44.998723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '690df4f937ba4ca1a7ae8bf0829a56c9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.067393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '690df4f937ba4ca1a7ae8bf0829a56c9'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.094976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1319/2631] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:44 2022] DELETE /identity/v3/users/690df4f937ba4ca1a7ae8bf0829a56c9 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:45.325369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:45.327199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:45.341099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90761cd4-1029-4325-b634-d74f4d930152 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:45.400528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:45.401505 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:45.401625 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:45.401933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] PATH_INFO: `/v3/users/5b268b76465541e19c89ed00294c9120` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:45.403617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b268b76465541e19c89ed00294c9120)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:45.405276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:45.685260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:45.686770 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:45.695232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b268b76465541e19c89ed00294c9120'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.700712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a5072-aadf-463b-9e69-df83fb071527 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:45.706254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:45.706968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:45.707254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:45.707527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] PATH_INFO: `/v3/projects/3565435243424acbb5e0ac8600bbace6` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:45.708751 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3565435243424acbb5e0ac8600bbace6)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:45.710709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:45.816105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b268b76465541e19c89ed00294c9120'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.824597 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b268b76465541e19c89ed00294c9120'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.835510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3565435243424acbb5e0ac8600bbace6', 'request_id': 'req-79319afb-1f00-46e6-91ae-8cfc994f3f62'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.838549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b268b76465541e19c89ed00294c9120'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.839341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-dbff2d34-b442-4473-859a-51c4842463ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b268b76465541e19c89ed00294c9120'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.842200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3565435243424acbb5e0ac8600bbace6', 'request_id': 'req-79319afb-1f00-46e6-91ae-8cfc994f3f62'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.846196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1313/2632] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:45 2022] DELETE /identity/v3/users/5b268b76465541e19c89ed00294c9120 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:45.851776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3565435243424acbb5e0ac8600bbace6', 'request_id': 'req-79319afb-1f00-46e6-91ae-8cfc994f3f62'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.892238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:45.892532 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:45.892810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:45.925871 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] MFA Rules not processed for user `724b68c33d1c49738f2bc1ad4291e496`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:45.927370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:45.971188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] The token cache is being invalidate because project 3565435243424acbb5e0ac8600bbace6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:45.971631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.972580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-79319afb-1f00-46e6-91ae-8cfc994f3f62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:45.977659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1320/2633] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:45 2022] DELETE /identity/v3/projects/3565435243424acbb5e0ac8600bbace6 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:45.979613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ee8c-f7ec-475c-86b6-e6fa56a180eb None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:45.980497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ee8c-f7ec-475c-86b6-e6fa56a180eb None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:45.980497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ee8c-f7ec-475c-86b6-e6fa56a180eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.008013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-b466ee8c-f7ec-475c-86b6-e6fa56a180eb None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:46.009317 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b466ee8c-f7ec-475c-86b6-e6fa56a180eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:46.019556 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1314/2634] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:46.034435 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.037799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:46.102519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1321/2635] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:46.112736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.113273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.113744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.124228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ebfc33-bba9-4d1c-ac61-d880162dcfb4 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.129339 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.130181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.130469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.130739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.139915 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:46.140145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.141568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:46.141732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.151615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1315/2636] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:32:46.161659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1322/2637] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:46.165818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.177553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0db0248-9998-4fe1-89e0-990b2bb21bc9 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.185707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.186575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.186960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.187940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.188752 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:32:46.189116 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.189459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.191138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.191304 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:46.209724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1316/2638] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:32:46.210720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.227392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78dcdb-e1bd-4116-a8b5-3e8373e5ccc0 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.231849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad8af8-f15d-4381-a3dd-21a4bf9126f4 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.233819 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.235105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.235346 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.235619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] PATH_INFO: `/v3/projects/57e40b52248c4b86bbfa379fbe10f981` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.237455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57e40b52248c4b86bbfa379fbe10f981)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.239426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.244499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.245349 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.246106 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.246565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.247915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.250085 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.278668 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:46.492250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1317/2639] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:46 2022] POST /identity/v3/projects => generated 381 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:46.499645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.503431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57e40b52248c4b86bbfa379fbe10f981', 'request_id': 'req-2e658b8c-9be1-44a5-b5ba-7b8616c79496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:46.510061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57e40b52248c4b86bbfa379fbe10f981', 'request_id': 'req-2e658b8c-9be1-44a5-b5ba-7b8616c79496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:46.516691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57e40b52248c4b86bbfa379fbe10f981', 'request_id': 'req-2e658b8c-9be1-44a5-b5ba-7b8616c79496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:46.570338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34e233-fae1-4251-8062-d6a8dd0203ad admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.575367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.576015 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.576296 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.576570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.577292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.579306 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.740497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] The token cache is being invalidate because project 57e40b52248c4b86bbfa379fbe10f981 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:46.740497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:46.740497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:46.740497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1323/2640] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:46 2022] DELETE /identity/v3/projects/57e40b52248c4b86bbfa379fbe10f981 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:46.742870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.744196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:46.810409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e658b8c-9be1-44a5-b5ba-7b8616c79496 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.819092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.819746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.820103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.820348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] PATH_INFO: `/v3/users/37d40726536f4cc49d43643476b06493` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.821528 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d40726536f4cc49d43643476b06493)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.822481 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1318/2641] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:46 2022] POST /identity/v3/users => generated 291 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:32:46.823510 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.826192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.828317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:46.840350 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d07c-7b75-4953-8b79-00335b175dc1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.854200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.854829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.855105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.855375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.856065 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.857698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.868206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1319/2642] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:32:46.872472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.882539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168b2c6d-11b8-42f6-8441-97108677c933 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.887308 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.887916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.888219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.888491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.889205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.891314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.901861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1320/2643] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:32:46.906603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:46.917200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51bf4d-7b49-41f8-8169-572d2e8cb6ed admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:46.921959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:46.922607 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:46.922889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:46.923165 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] PATH_INFO: `/v3/projects/965c5dd6b75e4c25b5b590abd561548b/users/345a1781201a43c4849a6eb3f2825946/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:46.937302 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965c5dd6b75e4c25b5b590abd561548b, user_id=345a1781201a43c4849a6eb3f2825946, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:46.940219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:46.992211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:47.072899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1321/2644] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:46 2022] PUT /identity/v3/projects/965c5dd6b75e4c25b5b590abd561548b/users/345a1781201a43c4849a6eb3f2825946/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:32:47.073720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:47.075310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:47.102431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d40726536f4cc49d43643476b06493'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.102431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d40726536f4cc49d43643476b06493'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.115018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d40726536f4cc49d43643476b06493'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.115575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d40726536f4cc49d43643476b06493'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.149341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148efeac-c825-414b-b18e-96a563e8f3a6 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:47.153276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:47.153932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:47.154217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:47.154495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:47.156455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:47.204256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-7b25a5c1-f4c1-4b5d-90e7-3a038db0ca51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d40726536f4cc49d43643476b06493'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.221339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1324/2645] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:46 2022] DELETE /identity/v3/users/37d40726536f4cc49d43643476b06493 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:32:47.221339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:47.221339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:47.221339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:47.229003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:47.230801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:47.244630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1322/2646] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:47.254367 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] MFA Rules not processed for user `345a1781201a43c4849a6eb3f2825946`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:47.255633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:47.331562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1325/2647] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:47.335086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:47.336522 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:47.404507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3c7c51-4bd3-4475-8944-f4cdd8b2b545 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:47.461990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:47.462619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:47.462897 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:47.463169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:47.463845 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:47.465797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:47.578547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1323/2648] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:47 2022] POST /identity/v3/projects => generated 379 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:32:47.581249 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:47.585988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:47.586267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:47.606059 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d929436-be24-46b4-9ab9-fc2f9738262f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:47.662201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66429d4b-f73b-4822-bfbf-fc551bd0f85c admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:47.667250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:47.667869 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:47.670155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:47.670155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:47.670155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:47.671107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:47.671947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:47.672667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:47.673023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:47.673370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] PATH_INFO: `/v3/projects/7c9e7632a5e64bc7bb8f8a63472c4c7d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:47.674768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c9e7632a5e64bc7bb8f8a63472c4c7d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:47.676928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:47.792539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1324/2649] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:47 2022] POST /identity/v3/users => generated 296 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:47.796598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:47.806309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5455ced-3117-40f6-af87-d7cb457abf63 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:47.811038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:47.811641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:47.811917 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:47.812689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:47.813415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:47.815048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:47.829170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1325/2650] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:32:47.830186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:47.839179 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c9e7632a5e64bc7bb8f8a63472c4c7d', 'request_id': 'req-50f5971e-866e-4843-8dad-0e59c74d5564'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.839877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca831ad-97d3-45b0-8357-7a0cb97c3986 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:47.844661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c9e7632a5e64bc7bb8f8a63472c4c7d', 'request_id': 'req-50f5971e-866e-4843-8dad-0e59c74d5564'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.851394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c9e7632a5e64bc7bb8f8a63472c4c7d', 'request_id': 'req-50f5971e-866e-4843-8dad-0e59c74d5564'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.898650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:47.899328 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:47.899630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:47.900258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] PATH_INFO: `/v3/projects/e950a4fc2a2648628f51303a2d94c3b4/users/c40307bf45fa494eabefac6f3836dcea/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:47.915066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e950a4fc2a2648628f51303a2d94c3b4, user_id=c40307bf45fa494eabefac6f3836dcea, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:47.917758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:47.963961 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] The token cache is being invalidate because project 7c9e7632a5e64bc7bb8f8a63472c4c7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:47.964256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.974395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:47.974395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1326/2651] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:47 2022] DELETE /identity/v3/projects/7c9e7632a5e64bc7bb8f8a63472c4c7d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:48.016841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1326/2652] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:47 2022] PUT /identity/v3/projects/e950a4fc2a2648628f51303a2d94c3b4/users/c40307bf45fa494eabefac6f3836dcea/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 18:32:48.020869 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:48.022378 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:48.035828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f5971e-866e-4843-8dad-0e59c74d5564 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:48.108232 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d378f-a39f-48a4-9ee8-b841929eaf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:48.109560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d378f-a39f-48a4-9ee8-b841929eaf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:48.109885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d378f-a39f-48a4-9ee8-b841929eaf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:48.110166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d378f-a39f-48a4-9ee8-b841929eaf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:48.115331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d378f-a39f-48a4-9ee8-b841929eaf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:48.115331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d378f-a39f-48a4-9ee8-b841929eaf7b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:48.129610 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1327/2653] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:48.133781 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:48.145641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2364b9d-bf23-4db8-a19b-56014288b4cd admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:48.150960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aced7312-1c64-4a95-971d-4d51414a842a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:48.151804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced7312-1c64-4a95-971d-4d51414a842a admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:48.152331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced7312-1c64-4a95-971d-4d51414a842a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:48.152613 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aced7312-1c64-4a95-971d-4d51414a842a admin admin] PATH_INFO: `/v3/projects/e950a4fc2a2648628f51303a2d94c3b4/users/c40307bf45fa494eabefac6f3836dcea/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:48.154742 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced7312-1c64-4a95-971d-4d51414a842a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e950a4fc2a2648628f51303a2d94c3b4, user_id=c40307bf45fa494eabefac6f3836dcea, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:48.157640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aced7312-1c64-4a95-971d-4d51414a842a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:48.169956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1327/2654] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:48 2022] PUT /identity/v3/projects/e950a4fc2a2648628f51303a2d94c3b4/users/c40307bf45fa494eabefac6f3836dcea/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:48.180972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:48.181266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:48.181548 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:48.227734 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] MFA Rules not processed for user `c40307bf45fa494eabefac6f3836dcea`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:48.229924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:48.243100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:48.243100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:48.243100 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:48.264449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] MFA Rules not processed for user `724b68c33d1c49738f2bc1ad4291e496`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:48.266314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:48.317673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1328/2655] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:48.325108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:48.326551 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:48.332776 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1328/2656] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:32:48.393190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84770bf4-acd7-42f7-97d0-b7500ecf2117 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:48.396972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:48.397594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:48.397905 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:48.398189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:48.415015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:48.415015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:48.420465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1329/2657] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:48 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:32:48.478224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:48.575243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:48.576762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:48.643683 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb56b188-6434-418d-90ec-b1137edb6943 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:48.647476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660b41f-7bc4-4779-8447-5f7ec73eae30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:48.648098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b41f-7bc4-4779-8447-5f7ec73eae30 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:48.648372 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b41f-7bc4-4779-8447-5f7ec73eae30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:48.648695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660b41f-7bc4-4779-8447-5f7ec73eae30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:48.650651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3660b41f-7bc4-4779-8447-5f7ec73eae30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:48.661009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b41f-7bc4-4779-8447-5f7ec73eae30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:48.662498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660b41f-7bc4-4779-8447-5f7ec73eae30 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:48.670684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1329/2658] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:48.903044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:49.085121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:49.190266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c52a0-e71b-469a-bba3-115375d1e04b service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:49.195374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:49.196028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:49.196456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:49.196733 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] PATH_INFO: `/v3/users/345a1781201a43c4849a6eb3f2825946` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:49.197959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] RBAC: Authorizing `identity:delete_user(user_id=345a1781201a43c4849a6eb3f2825946)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:49.199889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:49.430498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '345a1781201a43c4849a6eb3f2825946'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:49.431390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '345a1781201a43c4849a6eb3f2825946'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:49.444873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '345a1781201a43c4849a6eb3f2825946'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:49.446490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '345a1781201a43c4849a6eb3f2825946'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:49.563776 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '345a1781201a43c4849a6eb3f2825946'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:49.579490 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1330/2659] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:49 2022] DELETE /identity/v3/users/345a1781201a43c4849a6eb3f2825946 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:49.583873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbd584-d537-48ad-8396-af17010f361c None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:49.584164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbd584-d537-48ad-8396-af17010f361c None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:49.584498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fbd584-d537-48ad-8396-af17010f361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:49.607982 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-69fbd584-d537-48ad-8396-af17010f361c None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:49.610077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-69fbd584-d537-48ad-8396-af17010f361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:49.690956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1330/2660] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:49.701406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:49.703014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:49.776538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf38e7e-8689-417e-9a56-1da9c001b782 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:49.787652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:49.788382 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:49.789284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:49.789570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:49.802599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:49.804231 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:49.817657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1331/2661] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:49.844226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:50.334034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbd584-d537-48ad-8396-af17010f361c None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:50.336257 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-69fbd584-d537-48ad-8396-af17010f361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:50.349543 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fbd584-d537-48ad-8396-af17010f361c None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:50.358480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:50.358480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:50.358480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:50.358480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] PATH_INFO: `/v3/projects/965c5dd6b75e4c25b5b590abd561548b` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:50.359913 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965c5dd6b75e4c25b5b590abd561548b)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:50.360646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:50.569847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965c5dd6b75e4c25b5b590abd561548b', 'request_id': 'req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:50.587160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:50.683609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965c5dd6b75e4c25b5b590abd561548b', 'request_id': 'req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:50.690278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965c5dd6b75e4c25b5b590abd561548b', 'request_id': 'req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:50.702533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] The token cache is being invalidate because project 965c5dd6b75e4c25b5b590abd561548b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:50.703091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:50.703449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:50.705291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1331/2662] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:50 2022] DELETE /identity/v3/projects/965c5dd6b75e4c25b5b590abd561548b => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:50.709255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:50.719322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a507bd-5b51-4600-9385-6bf8c7495825 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:50.776292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:50.776935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:50.777214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:50.777484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] PATH_INFO: `/v3/users/c40307bf45fa494eabefac6f3836dcea` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:50.778670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c40307bf45fa494eabefac6f3836dcea)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:50.781103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:51.033082 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c40307bf45fa494eabefac6f3836dcea'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:51.033670 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c40307bf45fa494eabefac6f3836dcea'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:51.045491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c40307bf45fa494eabefac6f3836dcea'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:51.046180 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c40307bf45fa494eabefac6f3836dcea'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:51.174866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-b391da72-7fec-423b-ab37-7adc74f786f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c40307bf45fa494eabefac6f3836dcea'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:51.188671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1332/2663] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:32:50 2022] DELETE /identity/v3/users/c40307bf45fa494eabefac6f3836dcea => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:51.726157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:51.727900 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:51.743338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:51.750523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c30c1c-2ef5-45af-9ea1-ddaa30198f01 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:51.812536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:51.813179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:51.813455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:51.813726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] PATH_INFO: `/v3/projects/e950a4fc2a2648628f51303a2d94c3b4` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:51.814883 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e950a4fc2a2648628f51303a2d94c3b4)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:51.817038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:51.987959 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e950a4fc2a2648628f51303a2d94c3b4', 'request_id': 'req-b3c7848e-a048-4203-89c4-31b51655e46b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:52.083662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e950a4fc2a2648628f51303a2d94c3b4', 'request_id': 'req-b3c7848e-a048-4203-89c4-31b51655e46b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:52.090070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e950a4fc2a2648628f51303a2d94c3b4', 'request_id': 'req-b3c7848e-a048-4203-89c4-31b51655e46b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:52.102298 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] The token cache is being invalidate because project e950a4fc2a2648628f51303a2d94c3b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:32:52.102596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:52.108402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b3c7848e-a048-4203-89c4-31b51655e46b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:32:52.108402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1332/2664] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:32:51 2022] DELETE /identity/v3/projects/e950a4fc2a2648628f51303a2d94c3b4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:52.113867 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9089-8a52-4984-b56f-b154fe979d67 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.114440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9089-8a52-4984-b56f-b154fe979d67 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.114440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e9089-8a52-4984-b56f-b154fe979d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.135445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-8a0e9089-8a52-4984-b56f-b154fe979d67 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:52.136701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-8a0e9089-8a52-4984-b56f-b154fe979d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:52.197315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1333/2665] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:52.205687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a75fc-466b-4681-8d51-27cc75809fcc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.206011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a75fc-466b-4681-8d51-27cc75809fcc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.206290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986a75fc-466b-4681-8d51-27cc75809fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.227389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-986a75fc-466b-4681-8d51-27cc75809fcc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:52.228598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-986a75fc-466b-4681-8d51-27cc75809fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:52.236653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1333/2666] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:52.241078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e9089-8a52-4984-b56f-b154fe979d67 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:52.251248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e9089-8a52-4984-b56f-b154fe979d67 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:52.256323 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:52.256935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.257212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.257485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.258210 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:32:52.258512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:52.260176 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:52.272580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1334/2667] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:32:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:32:52.276834 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a75fc-466b-4681-8d51-27cc75809fcc None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:52.286228 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986a75fc-466b-4681-8d51-27cc75809fcc None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:52.290860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:52.291455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.291727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.291993 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.292675 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:52.294647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:52.443419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1334/2668] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:32:52 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:32:52.444507 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:52.455266 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e049ba-15fc-45a8-8d8c-3b89d3377f09 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:52.507363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:52.516968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:52.518960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.518960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.518960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.518960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:52.520899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:52.615022 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:52.672920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1335/2669] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:32:52 2022] POST /identity/v3/users => generated 288 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:32:52.678030 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:52.688616 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95302a8-2e5d-4e07-9efa-8f6c0056693a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:52.692721 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:52.693354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.693638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.693953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.694644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:52.696238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:52.706640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1335/2670] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:52.710587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:52.720788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123759e7-8115-4f0f-a3d4-9305c8ae9995 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:52.725559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357987a9-5729-47d6-a5cf-e1687491df38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:52.726200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357987a9-5729-47d6-a5cf-e1687491df38 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.726485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357987a9-5729-47d6-a5cf-e1687491df38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.726758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357987a9-5729-47d6-a5cf-e1687491df38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.727532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357987a9-5729-47d6-a5cf-e1687491df38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:52.729124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357987a9-5729-47d6-a5cf-e1687491df38 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:52.739500 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1336/2671] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:32:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:32:52.743548 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:52.754291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f38c85-048b-4617-a588-937c71065932 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:52.758785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:52.759436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.759713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.759988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] PATH_INFO: `/v3/projects/b2da7265155c4df0b465ee39d0e32632/users/3511a37d499c4b71ad56b2910e010e6d/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:52.774569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2da7265155c4df0b465ee39d0e32632, user_id=3511a37d499c4b71ad56b2910e010e6d, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:52.777286 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:52.901024 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1336/2672] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:32:52 2022] PUT /identity/v3/projects/b2da7265155c4df0b465ee39d0e32632/users/3511a37d499c4b71ad56b2910e010e6d/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:32:52.911785 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8537-e07c-44d1-afa2-d25c22fa8faf None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:52.912067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8537-e07c-44d1-afa2-d25c22fa8faf None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:52.912390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2df8537-e07c-44d1-afa2-d25c22fa8faf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:53.070950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e2df8537-e07c-44d1-afa2-d25c22fa8faf None None] MFA Rules not processed for user `3511a37d499c4b71ad56b2910e010e6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:32:53.072189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e2df8537-e07c-44d1-afa2-d25c22fa8faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:53.140920 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1337/2673] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:32:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:32:53.153549 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:32:53.155284 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:32:53.217364 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c6e07d-75c6-4f49-b3f9-a4064693ac71 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:32:53.221611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441db234-62ef-4ca2-8ccf-56d1aeb77d37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:32:53.222269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db234-62ef-4ca2-8ccf-56d1aeb77d37 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:32:53.222553 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db234-62ef-4ca2-8ccf-56d1aeb77d37 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:32:53.222828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441db234-62ef-4ca2-8ccf-56d1aeb77d37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:32:53.231574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441db234-62ef-4ca2-8ccf-56d1aeb77d37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:32:53.232981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:53.235904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441db234-62ef-4ca2-8ccf-56d1aeb77d37 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:32:53.245132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1337/2674] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:32:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:32:53.689635 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:32:54.597608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:04.204089 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:05.078338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:20.095047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df8537-e07c-44d1-afa2-d25c22fa8faf None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:20.160320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2df8537-e07c-44d1-afa2-d25c22fa8faf None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:20.164889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:20.165523 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:20.165828 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:20.166107 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] PATH_INFO: `/v3/users/3511a37d499c4b71ad56b2910e010e6d` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:20.167264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3511a37d499c4b71ad56b2910e010e6d)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:20.169175 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:20.438481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3511a37d499c4b71ad56b2910e010e6d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:20.439140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3511a37d499c4b71ad56b2910e010e6d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:20.451288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3511a37d499c4b71ad56b2910e010e6d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:20.451955 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3511a37d499c4b71ad56b2910e010e6d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:20.532728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3511a37d499c4b71ad56b2910e010e6d'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:20.546162 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1338/2675] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:33:20 2022] DELETE /identity/v3/users/3511a37d499c4b71ad56b2910e010e6d => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:20.551253 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:20.551816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:20.551929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:20.571429 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:20.572629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:20.630611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1338/2676] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:33:20.640265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:20.641669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:20.700281 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd03b4-5fb0-4094-804b-1eae8242a1a8 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:20.703972 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7f43c0-b8ec-4b80-8e30-e13f799045d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:20.709607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f43c0-b8ec-4b80-8e30-e13f799045d4 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:20.709607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f43c0-b8ec-4b80-8e30-e13f799045d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:20.709607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7f43c0-b8ec-4b80-8e30-e13f799045d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:20.714505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f43c0-b8ec-4b80-8e30-e13f799045d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:20.715903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7f43c0-b8ec-4b80-8e30-e13f799045d4 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:20.725978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1339/2677] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:33:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:33:21.246972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:21.247692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:21.260643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e86c890-0918-4cd1-9b4a-0466d89cf660 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:21.265252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:21.266017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:21.266295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:21.266579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] PATH_INFO: `/v3/projects/b2da7265155c4df0b465ee39d0e32632` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:21.267737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2da7265155c4df0b465ee39d0e32632)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:21.270462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:21.438215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2da7265155c4df0b465ee39d0e32632', 'request_id': 'req-de5f8611-7838-4efa-9770-9ce638c28ea0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:21.550899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2da7265155c4df0b465ee39d0e32632', 'request_id': 'req-de5f8611-7838-4efa-9770-9ce638c28ea0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:21.557169 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2da7265155c4df0b465ee39d0e32632', 'request_id': 'req-de5f8611-7838-4efa-9770-9ce638c28ea0'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:21.569716 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] The token cache is being invalidate because project b2da7265155c4df0b465ee39d0e32632 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:33:21.570040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:21.570707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-de5f8611-7838-4efa-9770-9ce638c28ea0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:21.572506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1339/2678] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:33:21 2022] DELETE /identity/v3/projects/b2da7265155c4df0b465ee39d0e32632 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:21.577545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc430d-6316-44c3-97ae-5ca33a9db4c3 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:21.578088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc430d-6316-44c3-97ae-5ca33a9db4c3 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:21.578204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc430d-6316-44c3-97ae-5ca33a9db4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:21.598646 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4ccc430d-6316-44c3-97ae-5ca33a9db4c3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:21.599943 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4ccc430d-6316-44c3-97ae-5ca33a9db4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:21.618078 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:21.660825 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1340/2679] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:21.727807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccf98-074d-48c1-aea6-5f03af08fcc3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:21.728092 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccf98-074d-48c1-aea6-5f03af08fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:21.728375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eccf98-074d-48c1-aea6-5f03af08fcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:21.748483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-50eccf98-074d-48c1-aea6-5f03af08fcc3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:21.749821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-50eccf98-074d-48c1-aea6-5f03af08fcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:21.758410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1340/2680] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:21.762615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc430d-6316-44c3-97ae-5ca33a9db4c3 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:21.772224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc430d-6316-44c3-97ae-5ca33a9db4c3 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:21.776681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:21.777279 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:21.777599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:21.777899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:21.778581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:33:21.778878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:21.780440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:21.792526 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1341/2681] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:33:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:33:21.800859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eccf98-074d-48c1-aea6-5f03af08fcc3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:21.810575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eccf98-074d-48c1-aea6-5f03af08fcc3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:21.815488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:21.816096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:21.816376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:21.816650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:21.817329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:21.819463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:21.991953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1341/2682] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:33:21 2022] POST /identity/v3/projects => generated 373 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:33:21.993056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.004782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8870f422-525b-4ab4-b010-acd39624138d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.069023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.070125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.070125 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.070316 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.070862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.072768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.167492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1342/2683] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:33:21 2022] POST /identity/v3/users => generated 287 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:33:22.170904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.182674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fdf9a7-10af-4722-a92c-b1b4ad0fbca8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.188576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.189692 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.190048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.190322 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.191090 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.192931 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.208932 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1342/2684] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:33:22.210255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.224814 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a84b1-e6fc-47e9-9f1a-3be588939251 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.230379 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c7a000-d9e2-4dd1-bbc5-7be1c7519988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.231245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7a000-d9e2-4dd1-bbc5-7be1c7519988 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.231682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7a000-d9e2-4dd1-bbc5-7be1c7519988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.231967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c7a000-d9e2-4dd1-bbc5-7be1c7519988 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.232860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7a000-d9e2-4dd1-bbc5-7be1c7519988 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.234744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c7a000-d9e2-4dd1-bbc5-7be1c7519988 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.250307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1343/2685] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:33:22.251634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.263212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9d30a-74a2-4c47-8953-0917f42e0963 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.269192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.271091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.271091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.271091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] PATH_INFO: `/v3/projects/4273b3eb1fc041f69abec0f9af21529a/users/582a40d138264b9c99a76ed01854d145/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.289354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4273b3eb1fc041f69abec0f9af21529a, user_id=582a40d138264b9c99a76ed01854d145, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.292340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.368498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1343/2686] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:33:22 2022] PUT /identity/v3/projects/4273b3eb1fc041f69abec0f9af21529a/users/582a40d138264b9c99a76ed01854d145/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:22.379337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ba26a-7497-413a-b5c6-a3fab3af01df None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.379650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ba26a-7497-413a-b5c6-a3fab3af01df None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.379929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6ba26a-7497-413a-b5c6-a3fab3af01df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.413588 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6a6ba26a-7497-413a-b5c6-a3fab3af01df None None] MFA Rules not processed for user `582a40d138264b9c99a76ed01854d145`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:22.414912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6a6ba26a-7497-413a-b5c6-a3fab3af01df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:22.484636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1344/2687] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:22.489655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.512880 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:22.555647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f1a23c-89aa-47ae-bdab-d442c0322e9b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.561213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.561861 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.562155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.562430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.563095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.565812 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.630294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1344/2688] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:33:22 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:33:22.631620 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ba26a-7497-413a-b5c6-a3fab3af01df None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.642931 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6ba26a-7497-413a-b5c6-a3fab3af01df None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.655878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:22.702966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.703615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.703891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.704270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.704939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.706936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.807812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1345/2689] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:33:22 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:33:22.811916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.822800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23662991-8955-4289-8da6-fb4f09ed6fce admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.827769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.828516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.828799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.829138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.829795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.831399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.842212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1345/2690] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:33:22.846936 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.857111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9d3bc9-cca3-4cd1-a7ad-e637f7af0003 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.862437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8685fa0-7ca5-4750-9f55-49a0b65b388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.863114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8685fa0-7ca5-4750-9f55-49a0b65b388d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.863396 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8685fa0-7ca5-4750-9f55-49a0b65b388d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.863665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8685fa0-7ca5-4750-9f55-49a0b65b388d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.864358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8685fa0-7ca5-4750-9f55-49a0b65b388d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.866354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8685fa0-7ca5-4750-9f55-49a0b65b388d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:22.876198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1346/2691] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:33:22.880359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:22.890698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6929793-1b9b-4d43-b046-2bed6f790398 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:22.895976 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:22.896652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:22.896935 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:22.897288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] PATH_INFO: `/v3/projects/81b6138ff37e4b589b4ab775adebc388/users/b882c929f902494f99767c720bdbfaae/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:22.913488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81b6138ff37e4b589b4ab775adebc388, user_id=b882c929f902494f99767c720bdbfaae, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:22.916455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:23.046206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1346/2692] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:33:22 2022] PUT /identity/v3/projects/81b6138ff37e4b589b4ab775adebc388/users/b882c929f902494f99767c720bdbfaae/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:23.056835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acabfa2-7e94-4094-a6c7-4eaf828e259a None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.057117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acabfa2-7e94-4094-a6c7-4eaf828e259a None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.057389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acabfa2-7e94-4094-a6c7-4eaf828e259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.089260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-1acabfa2-7e94-4094-a6c7-4eaf828e259a None None] MFA Rules not processed for user `b882c929f902494f99767c720bdbfaae`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:23.090629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1acabfa2-7e94-4094-a6c7-4eaf828e259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:23.180668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1347/2693] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:23.180822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:23.244038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb6dc7-f7e6-47af-bf7a-26107f144130 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:23.248863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:23.249483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.249793 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.250067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.250731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:23.253608 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:23.423365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1347/2694] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:33:23 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:33:23.427310 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acabfa2-7e94-4094-a6c7-4eaf828e259a None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:23.439212 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acabfa2-7e94-4094-a6c7-4eaf828e259a None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:23.499541 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:23.500163 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.500438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.500710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.501384 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:23.504096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:23.619984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1348/2695] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:33:23 2022] POST /identity/v3/users => generated 294 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:33:23.624055 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:23.635188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8928f90-42df-48dc-acff-dd897da7bb6b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:23.639699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:23.640309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.640733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.641012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.641701 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:23.643425 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:23.658664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1348/2696] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:33:23.663152 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:23.673673 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a3afe-78ba-4d2b-81b1-73d28267c213 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:23.679354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:23.680100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.680438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.680712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] PATH_INFO: `/v3/projects/17850531ecee47cea84a2dad549cf26f/users/d130a57ac11f4b02a95e0b186e26d18c/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.695636 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:23.698947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17850531ecee47cea84a2dad549cf26f, user_id=d130a57ac11f4b02a95e0b186e26d18c, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:23.701754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:23.813434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1349/2697] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:33:23 2022] PUT /identity/v3/projects/17850531ecee47cea84a2dad549cf26f/users/d130a57ac11f4b02a95e0b186e26d18c/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:23.818411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:23.828511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e093b69-0a27-499a-a750-e324dc48b6ff admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:23.869894 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:23.886663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce8d257-253e-4f9a-aebc-19cac938b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:23.886663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d257-253e-4f9a-aebc-19cac938b91f admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.886907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d257-253e-4f9a-aebc-19cac938b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.887156 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce8d257-253e-4f9a-aebc-19cac938b91f admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.887904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8d257-253e-4f9a-aebc-19cac938b91f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:23.889571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce8d257-253e-4f9a-aebc-19cac938b91f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:23.900198 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1349/2698] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 18:33:23.904487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:23.915559 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f4a689-2d7d-4b2f-a195-dcee2f6c30a7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:23.920261 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:23.920922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.921203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.921478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] PATH_INFO: `/v3/projects/17850531ecee47cea84a2dad549cf26f/users/d130a57ac11f4b02a95e0b186e26d18c/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.923461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=17850531ecee47cea84a2dad549cf26f, user_id=d130a57ac11f4b02a95e0b186e26d18c, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:23.926270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:23.937023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1350/2699] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:33:23 2022] PUT /identity/v3/projects/17850531ecee47cea84a2dad549cf26f/users/d130a57ac11f4b02a95e0b186e26d18c/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:23.949266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cacce-3a28-4f86-a9cb-5dbe1bb10e3d None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:23.949555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cacce-3a28-4f86-a9cb-5dbe1bb10e3d None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:23.949870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99cacce-3a28-4f86-a9cb-5dbe1bb10e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:23.981386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-b99cacce-3a28-4f86-a9cb-5dbe1bb10e3d None None] MFA Rules not processed for user `d130a57ac11f4b02a95e0b186e26d18c`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:23.982749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-b99cacce-3a28-4f86-a9cb-5dbe1bb10e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:24.051856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1350/2700] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:23 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:24.063319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:24.065811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:24.134144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295ef74-1333-44e5-8794-95d4242679ac admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:24.146095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cf40cf-16ea-4d0c-9fe5-173303957f55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:24.146095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf40cf-16ea-4d0c-9fe5-173303957f55 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:24.146095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf40cf-16ea-4d0c-9fe5-173303957f55 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:24.146095 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cf40cf-16ea-4d0c-9fe5-173303957f55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:24.203809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf40cf-16ea-4d0c-9fe5-173303957f55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:24.205250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cf40cf-16ea-4d0c-9fe5-173303957f55 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:24.214950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1351/2701] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:33:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:33:26.249397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cacce-3a28-4f86-a9cb-5dbe1bb10e3d None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:26.264728 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99cacce-3a28-4f86-a9cb-5dbe1bb10e3d None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:26.268754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:26.269408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:26.269690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:26.271122 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:26.330829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:26.332376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:26.342083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1351/2702] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:33:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:33:26.877532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d2fb-d8d7-47d1-8142-73b4be1ee55d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:26.878790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d2fb-d8d7-47d1-8142-73b4be1ee55d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:26.878790 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed1d2fb-d8d7-47d1-8142-73b4be1ee55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:26.897907 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3ed1d2fb-d8d7-47d1-8142-73b4be1ee55d None None] MFA Rules not processed for user `e571a6378a0240cfbe40f4cc63e0486d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:26.899100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3ed1d2fb-d8d7-47d1-8142-73b4be1ee55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:26.954215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1352/2703] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:28.010555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:28.019291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ade2d8-dd4e-4cb3-a662-5c88cc837c87 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:28.023016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c089e-a316-4a7f-ba5c-40e526ed43be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:28.023634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c089e-a316-4a7f-ba5c-40e526ed43be service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:28.023914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c089e-a316-4a7f-ba5c-40e526ed43be service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:28.025732 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c089e-a316-4a7f-ba5c-40e526ed43be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:28.033307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c089e-a316-4a7f-ba5c-40e526ed43be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:28.034802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c089e-a316-4a7f-ba5c-40e526ed43be service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:28.045508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1352/2704] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:33:28 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:33:32.695397 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1d2fb-d8d7-47d1-8142-73b4be1ee55d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:32.738222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:32.761247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed1d2fb-d8d7-47d1-8142-73b4be1ee55d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:32.765835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:32.766485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:32.766767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:32.767043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] PATH_INFO: `/v3/users/582a40d138264b9c99a76ed01854d145` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:32.768330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=582a40d138264b9c99a76ed01854d145)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:32.770812 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:33.015967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582a40d138264b9c99a76ed01854d145'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:33.016639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582a40d138264b9c99a76ed01854d145'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:33.029348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582a40d138264b9c99a76ed01854d145'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:33.030112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582a40d138264b9c99a76ed01854d145'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:33.126842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582a40d138264b9c99a76ed01854d145'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:33.140004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1353/2705] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:33:32 2022] DELETE /identity/v3/users/582a40d138264b9c99a76ed01854d145 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:33.145208 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:33.145719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:33.145859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:33.164517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:33.165713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:33.209839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:33.223428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1353/2706] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:33.233233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:33.234669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:33.292298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d6ac0-9f5a-4d73-bf09-1daf764427cf admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:33.295860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:33.296471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:33.296746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:33.297015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:33.306105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:33.307506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:33.317809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1354/2707] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:33:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:33:33.826415 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:33.827853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:33.841585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca48cc-a059-40dd-b402-df33590bc4df None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:33.846239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:33.847414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:33.847885 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:33.848167 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] PATH_INFO: `/v3/projects/4273b3eb1fc041f69abec0f9af21529a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:33.849418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4273b3eb1fc041f69abec0f9af21529a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:33.851442 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:33.960948 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4273b3eb1fc041f69abec0f9af21529a', 'request_id': 'req-417ae854-b670-4516-9ca9-5891626f4100'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.046823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4273b3eb1fc041f69abec0f9af21529a', 'request_id': 'req-417ae854-b670-4516-9ca9-5891626f4100'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.053255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4273b3eb1fc041f69abec0f9af21529a', 'request_id': 'req-417ae854-b670-4516-9ca9-5891626f4100'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.064392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] The token cache is being invalidate because project 4273b3eb1fc041f69abec0f9af21529a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:33:34.064680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.065313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.066860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1354/2708] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:33:33 2022] DELETE /identity/v3/projects/4273b3eb1fc041f69abec0f9af21529a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:34.071491 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:34.081827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcfd60c-1f0f-4303-be4d-2425d2caac23 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:34.139851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:34.140485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:34.140761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:34.141031 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] PATH_INFO: `/v3/users/b882c929f902494f99767c720bdbfaae` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:34.142359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b882c929f902494f99767c720bdbfaae)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:34.144431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:34.145937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:34.318469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b882c929f902494f99767c720bdbfaae'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.319118 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b882c929f902494f99767c720bdbfaae'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.330988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b882c929f902494f99767c720bdbfaae'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.331594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b882c929f902494f99767c720bdbfaae'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.413362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b882c929f902494f99767c720bdbfaae'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:34.426182 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1355/2709] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:33:34 2022] DELETE /identity/v3/users/b882c929f902494f99767c720bdbfaae => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:34.871746 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:34.873785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:34.890307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ae854-b670-4516-9ca9-5891626f4100 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:34.947404 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:34.948053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:34.948329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:34.948601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] PATH_INFO: `/v3/projects/81b6138ff37e4b589b4ab775adebc388` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:34.949758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=81b6138ff37e4b589b4ab775adebc388)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:34.951674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:35.081841 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81b6138ff37e4b589b4ab775adebc388', 'request_id': 'req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.167150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81b6138ff37e4b589b4ab775adebc388', 'request_id': 'req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.173317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81b6138ff37e4b589b4ab775adebc388', 'request_id': 'req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.184848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] The token cache is being invalidate because project 81b6138ff37e4b589b4ab775adebc388 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:33:35.185143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.185816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.187455 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1355/2710] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:33:34 2022] DELETE /identity/v3/projects/81b6138ff37e4b589b4ab775adebc388 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:35.191749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:35.193960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:35.209072 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f937efac-5dd1-4f1d-bd82-51c3f2e7aed2 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:35.266891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:35.267537 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:35.267818 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:35.268096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] PATH_INFO: `/v3/users/d130a57ac11f4b02a95e0b186e26d18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:35.269330 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d130a57ac11f4b02a95e0b186e26d18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:35.271309 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:35.455560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd130a57ac11f4b02a95e0b186e26d18c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.457191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd130a57ac11f4b02a95e0b186e26d18c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.468036 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd130a57ac11f4b02a95e0b186e26d18c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.468723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd130a57ac11f4b02a95e0b186e26d18c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.543928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c135d029-3572-44ad-bdd1-95fbbafa0ba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd130a57ac11f4b02a95e0b186e26d18c'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:35.552220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:35.557191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1356/2711] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:33:35 2022] DELETE /identity/v3/users/d130a57ac11f4b02a95e0b186e26d18c => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:36.054477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:36.056542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:36.067510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:36.073403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8b1298-0c72-4db0-930b-4e1e63ad53ad admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:36.134572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:36.135323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:36.135730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:36.136218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] PATH_INFO: `/v3/projects/17850531ecee47cea84a2dad549cf26f` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:36.137527 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17850531ecee47cea84a2dad549cf26f)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:36.139635 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:36.338671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17850531ecee47cea84a2dad549cf26f', 'request_id': 'req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:36.492740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17850531ecee47cea84a2dad549cf26f', 'request_id': 'req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:36.498858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17850531ecee47cea84a2dad549cf26f', 'request_id': 'req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:36.510468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] The token cache is being invalidate because project 17850531ecee47cea84a2dad549cf26f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:33:36.510758 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:36.511410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a5e6a861-a353-481f-8786-c5bbc0bf8ec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:33:36.513243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1356/2712] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:33:36 2022] DELETE /identity/v3/projects/17850531ecee47cea84a2dad549cf26f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:36.518015 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405d6f-ebfd-40a6-afb4-8e26799caf86 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:36.518508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405d6f-ebfd-40a6-afb4-8e26799caf86 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:36.518612 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81405d6f-ebfd-40a6-afb4-8e26799caf86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:36.539894 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-81405d6f-ebfd-40a6-afb4-8e26799caf86 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:36.541111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-81405d6f-ebfd-40a6-afb4-8e26799caf86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:36.601273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1357/2713] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:33:36.609016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557a77-6785-4849-b930-0d1aae5463b3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:36.609300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557a77-6785-4849-b930-0d1aae5463b3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:36.609575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26557a77-6785-4849-b930-0d1aae5463b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:36.628685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-26557a77-6785-4849-b930-0d1aae5463b3 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:36.629916 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-26557a77-6785-4849-b930-0d1aae5463b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:36.638398 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1357/2714] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:36.642550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405d6f-ebfd-40a6-afb4-8e26799caf86 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:36.652682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81405d6f-ebfd-40a6-afb4-8e26799caf86 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:36.657222 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:36.657856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:36.658201 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:36.658427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:36.659114 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:33:36.659415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:36.661000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:36.673494 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1358/2715] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:33:36.678623 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557a77-6785-4849-b930-0d1aae5463b3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:36.688956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26557a77-6785-4849-b930-0d1aae5463b3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:36.694575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:36.695194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:36.695474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:36.695749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:36.696427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:36.698463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:36.831312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1358/2716] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:33:36 2022] POST /identity/v3/projects => generated 373 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:33:36.836147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:36.846493 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05764c8f-2e06-4f8f-ae64-e7551f1cd921 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:36.902312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:36.902923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:36.903202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:36.903476 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:36.904128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:36.906044 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:37.046061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1359/2717] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:33:36 2022] POST /identity/v3/users => generated 287 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:33:37.056476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:37.067052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96de51-70dc-4a06-98f0-363d35fb7475 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:37.072243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:37.072853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:37.073132 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:37.073405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:37.074121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:37.075708 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:37.086115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1359/2718] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:33:37.090070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:37.100563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9547f0e-cc06-44cf-b632-ea3232eb4282 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:37.106021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02f3ea5-8062-4441-877e-215c8b802a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:37.106648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3ea5-8062-4441-877e-215c8b802a6e admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:37.106938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3ea5-8062-4441-877e-215c8b802a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:37.107213 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02f3ea5-8062-4441-877e-215c8b802a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:37.107938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f3ea5-8062-4441-877e-215c8b802a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:37.113247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02f3ea5-8062-4441-877e-215c8b802a6e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:37.121842 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1360/2719] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:33:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:33:37.126157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:37.136891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcbc192-962f-4ba2-ac0a-ca5005ea11a6 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:37.141484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:37.142205 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:37.142485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:37.142761 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] PATH_INFO: `/v3/projects/691db63874a64ed380241bc3dd57cb8a/users/d29ce16f6d704fdbb135deed50057333/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:37.158537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=691db63874a64ed380241bc3dd57cb8a, user_id=d29ce16f6d704fdbb135deed50057333, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:37.161452 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:37.259335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1360/2720] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:33:37 2022] PUT /identity/v3/projects/691db63874a64ed380241bc3dd57cb8a/users/d29ce16f6d704fdbb135deed50057333/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:33:37.273387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cab88-0c1e-4a76-82f1-24b4f9c17389 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:37.273675 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cab88-0c1e-4a76-82f1-24b4f9c17389 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:37.273980 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cab88-0c1e-4a76-82f1-24b4f9c17389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:37.300534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-6b9cab88-0c1e-4a76-82f1-24b4f9c17389 None None] MFA Rules not processed for user `d29ce16f6d704fdbb135deed50057333`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:37.301717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6b9cab88-0c1e-4a76-82f1-24b4f9c17389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:37.355787 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:37.365472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1361/2721] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:37 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:37.376310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:33:37.378193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:37.413086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:37.436737 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dc498-58e9-4754-9af4-bdab75b25d81 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:33:37.440672 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd2352a-e728-48d3-8d8f-2fd00f9c4887 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:33:37.441569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2352a-e728-48d3-8d8f-2fd00f9c4887 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:37.441569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2352a-e728-48d3-8d8f-2fd00f9c4887 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:37.441843 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd2352a-e728-48d3-8d8f-2fd00f9c4887 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:37.451560 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2352a-e728-48d3-8d8f-2fd00f9c4887 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:33:37.453027 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd2352a-e728-48d3-8d8f-2fd00f9c4887 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:33:37.462399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1361/2722] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:33:37 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:33:40.452413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:33:40.452997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:33:40.452997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:33:40.471582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] MFA Rules not processed for user `d29ce16f6d704fdbb135deed50057333`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:33:40.472775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:33:40.480056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1362/2723] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:33:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:33:47.521172 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=12 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:33:50.466469 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:09.753480 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f226-bd38-4667-bc57-7f2ae60f4986 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:09.754363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f226-bd38-4667-bc57-7f2ae60f4986 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:09.754363 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090f226-bd38-4667-bc57-7f2ae60f4986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:09.772788 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8090f226-bd38-4667-bc57-7f2ae60f4986 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:09.774162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8090f226-bd38-4667-bc57-7f2ae60f4986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:09.828579 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1362/2724] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:34:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:09.978977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:09.980427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:10.049157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86747fb8-0b83-4560-baf1-4b0c8b256247 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:10.054258 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:10.054880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:10.055160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:10.055453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:10.063878 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:10.065451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:10.073414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1363/2725] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 18:34:10.961559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e841b-d529-4911-86e6-83124982a6c6 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:10.962050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e841b-d529-4911-86e6-83124982a6c6 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:10.962161 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e841b-d529-4911-86e6-83124982a6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:10.982186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-527e841b-d529-4911-86e6-83124982a6c6 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:10.983432 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-527e841b-d529-4911-86e6-83124982a6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:10.991058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1363/2726] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 18:34:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:11.003007 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:11.013401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad461e-8d9c-43e7-8ec8-3c2f72c2a9d9 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:11.018386 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:11.018981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:11.019260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:11.019532 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:11.027439 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:11.029488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:11.037455 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1364/2727] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:34:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:34:11.718428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce21f0-d43e-4d16-bb07-e33da844850a None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:11.718713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce21f0-d43e-4d16-bb07-e33da844850a None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:11.718987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce21f0-d43e-4d16-bb07-e33da844850a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:11.738724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a2ce21f0-d43e-4d16-bb07-e33da844850a None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:11.739960 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a2ce21f0-d43e-4d16-bb07-e33da844850a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:11.747908 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1364/2728] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 18:34:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:11.759649 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:11.770899 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756db0fb-bee0-4acc-b8f8-9cf02ae5c388 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:11.776030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:11.776627 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:11.776908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:11.777180 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:11.785705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:11.787307 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:11.796040 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1365/2729] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:34:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:34:12.411540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650fa00-4c64-4f13-8ffd-bb2a5290accc None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:12.412002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650fa00-4c64-4f13-8ffd-bb2a5290accc None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:12.412113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c650fa00-4c64-4f13-8ffd-bb2a5290accc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:12.430680 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-c650fa00-4c64-4f13-8ffd-bb2a5290accc None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:12.431905 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-c650fa00-4c64-4f13-8ffd-bb2a5290accc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:12.439774 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1365/2730] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 18:34:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:12.452086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:12.462531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28ffc87-58ac-4266-8f00-2e238028bf12 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:12.467512 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:12.468108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:12.468385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:12.468655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:12.476574 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:12.478169 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:12.486280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1366/2731] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 18:34:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 18:34:12.629533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6828b52-84b6-4140-80b6-40ab9a21f993 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:12.629859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6828b52-84b6-4140-80b6-40ab9a21f993 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:12.630140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6828b52-84b6-4140-80b6-40ab9a21f993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:12.649528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d6828b52-84b6-4140-80b6-40ab9a21f993 None None] MFA Rules not processed for user `724b68c33d1c49738f2bc1ad4291e496`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:12.650759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d6828b52-84b6-4140-80b6-40ab9a21f993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:12.708218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1366/2732] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:34:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:15.552826 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:15.615421 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c1ae9-a976-433d-b803-8dfa3b4e22a1 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:15.620100 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:15.620739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:15.621024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:15.621298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] PATH_INFO: `/v3/users/d29ce16f6d704fdbb135deed50057333` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:15.622467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d29ce16f6d704fdbb135deed50057333)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:15.625039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:15.865560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd29ce16f6d704fdbb135deed50057333'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:15.866252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd29ce16f6d704fdbb135deed50057333'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:15.870985 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:15.879243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd29ce16f6d704fdbb135deed50057333'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:15.879976 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd29ce16f6d704fdbb135deed50057333'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:15.964269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd29ce16f6d704fdbb135deed50057333'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:15.981352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1367/2733] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:34:15 2022] DELETE /identity/v3/users/d29ce16f6d704fdbb135deed50057333 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:34:15.986449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:15.986953 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:15.987057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:16.006726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:16.007943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:16.068806 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1367/2734] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:34:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:16.078534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:16.079935 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:16.142464 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefcf4cc-f4e6-4b78-837a-e7450b60fda9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:16.146138 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088ab927-eaed-4ac1-9052-bdc9c510065b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:16.146833 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab927-eaed-4ac1-9052-bdc9c510065b service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:16.147243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab927-eaed-4ac1-9052-bdc9c510065b service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:16.147997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088ab927-eaed-4ac1-9052-bdc9c510065b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:16.158149 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ab927-eaed-4ac1-9052-bdc9c510065b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:16.159608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088ab927-eaed-4ac1-9052-bdc9c510065b service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:16.169453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1368/2735] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:34:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:34:16.452176 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:16.454291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:16.466304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf6979-6463-4114-a0df-c0d9be8cfa20 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:16.471060 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:16.472138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:16.472138 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:16.472342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] PATH_INFO: `/v3/projects/691db63874a64ed380241bc3dd57cb8a` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:16.473444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=691db63874a64ed380241bc3dd57cb8a)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:16.475733 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:16.607154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:16.629305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '691db63874a64ed380241bc3dd57cb8a', 'request_id': 'req-6e50c714-38ac-41b8-9136-343713af6faf'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:16.774983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '691db63874a64ed380241bc3dd57cb8a', 'request_id': 'req-6e50c714-38ac-41b8-9136-343713af6faf'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:16.781046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '691db63874a64ed380241bc3dd57cb8a', 'request_id': 'req-6e50c714-38ac-41b8-9136-343713af6faf'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:16.793420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] The token cache is being invalidate because project 691db63874a64ed380241bc3dd57cb8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:34:16.793712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:16.794389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6e50c714-38ac-41b8-9136-343713af6faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:16.795919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1368/2736] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:34:16 2022] DELETE /identity/v3/projects/691db63874a64ed380241bc3dd57cb8a => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:34:16.801458 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37f5e-c903-499a-9311-454b2154c865 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:16.801984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37f5e-c903-499a-9311-454b2154c865 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:16.802188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f37f5e-c903-499a-9311-454b2154c865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:16.823652 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-90f37f5e-c903-499a-9311-454b2154c865 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:16.824841 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-90f37f5e-c903-499a-9311-454b2154c865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:16.885746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1369/2737] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:16.893735 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a65cc6-9011-4b2e-9a10-85c51707bcc7 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:16.894726 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a65cc6-9011-4b2e-9a10-85c51707bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:16.895043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a65cc6-9011-4b2e-9a10-85c51707bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:16.915678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-61a65cc6-9011-4b2e-9a10-85c51707bcc7 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:16.916891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-61a65cc6-9011-4b2e-9a10-85c51707bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:16.935641 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1369/2738] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:34:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 18:34:16.937132 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f37f5e-c903-499a-9311-454b2154c865 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:16.946983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f37f5e-c903-499a-9311-454b2154c865 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:16.951637 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:16.952247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:16.952534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:16.952809 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] PATH_INFO: `/v3/domains` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:16.953502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80552) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 18:34:16.953835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:16.964051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:16.967703 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1370/2739] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 18:34:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 18:34:16.972533 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a65cc6-9011-4b2e-9a10-85c51707bcc7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:16.981995 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a65cc6-9011-4b2e-9a10-85c51707bcc7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:16.987741 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:16.988414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:16.988695 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:16.993539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:16.993539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:16.993539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:17.103664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1370/2740] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 18:34:16 2022] POST /identity/v3/projects => generated 391 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 18:34:17.107967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:17.119005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a29c9af-7216-4cfb-97ea-55cb180f5f9b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:17.177297 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:17.182802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:17.182802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:17.182802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:17.182802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:17.182802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:17.189600 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:17.356865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1371/2741] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 18:34:17 2022] POST /identity/v3/users => generated 296 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 18:34:17.360170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:17.368819 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acfec58-1d34-4fdc-8c4d-62045f0f86f5 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:17.373794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:17.374521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:17.374808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:17.375083 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:17.375773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:17.377396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:17.388606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1371/2742] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:34:17.397321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:17.411302 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e94ce9-c656-4c8e-8e21-b275405463b6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:17.416023 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53b4d9-64fd-4aa6-b9b6-28cd0e5c6dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:17.416642 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53b4d9-64fd-4aa6-b9b6-28cd0e5c6dea admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:17.416937 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53b4d9-64fd-4aa6-b9b6-28cd0e5c6dea admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:17.417190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53b4d9-64fd-4aa6-b9b6-28cd0e5c6dea admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:17.417908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53b4d9-64fd-4aa6-b9b6-28cd0e5c6dea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:17.419616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53b4d9-64fd-4aa6-b9b6-28cd0e5c6dea admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:17.430755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1372/2743] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 18:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 18:34:17.439418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:17.449791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ca818-bf91-49e5-b26e-1f569c23e767 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:17.455098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:17.455762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:17.456040 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:17.456314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] PATH_INFO: `/v3/projects/1cc8334042e1427c9e02109f4d3f518c/users/ce9f2a4e4ed049dcba8a5adf8859fcc4/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:17.472064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=1cc8334042e1427c9e02109f4d3f518c, user_id=ce9f2a4e4ed049dcba8a5adf8859fcc4, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:17.475036 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:17.576536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1372/2744] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 18:34:17 2022] PUT /identity/v3/projects/1cc8334042e1427c9e02109f4d3f518c/users/ce9f2a4e4ed049dcba8a5adf8859fcc4/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:34:17.587436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:17.587725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:17.588018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:17.616045 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] MFA Rules not processed for user `ce9f2a4e4ed049dcba8a5adf8859fcc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:17.617265 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:17.681793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1373/2745] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:34:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:17.694115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:17.696070 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:17.764479 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db83d186-20e7-4c40-9388-00299e925bff admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:17.769713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:17.770371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:17.770651 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:17.770925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:17.781128 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:17.782915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:17.793303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1373/2746] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:34:17 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:34:27.405834 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:27.407239 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:27.464189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eace31-5627-4aec-89f5-6dc1537eac11 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:27.468067 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:27.468405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:27.468684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:27.468978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:27.470891 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:27.541334 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:27.542803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:27.554538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1374/2747] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:34:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:34:27.789122 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:28.727236 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:28.728643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:28.741162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a48277-090c-4746-be30-6e7f873694cb service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:28.744767 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f4e5ec-9125-4e15-8a4a-d18d2dcc34b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:28.748227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e5ec-9125-4e15-8a4a-d18d2dcc34b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:28.748227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e5ec-9125-4e15-8a4a-d18d2dcc34b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:28.748227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f4e5ec-9125-4e15-8a4a-d18d2dcc34b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:28.748227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-69f4e5ec-9125-4e15-8a4a-d18d2dcc34b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:28.761851 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e5ec-9125-4e15-8a4a-d18d2dcc34b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:28.763291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f4e5ec-9125-4e15-8a4a-d18d2dcc34b4 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:28.774836 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1374/2748] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:34:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:34:37.549364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:INSERT=3,keystone:SELECT=93 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:38.769566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:38.970522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:39.033234 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b219a131-bcce-4c38-8dea-c6867d5b7834 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:39.037775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:39.055128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:39.055128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:39.055128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] PATH_INFO: `/v3/users/ce9f2a4e4ed049dcba8a5adf8859fcc4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:39.055128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce9f2a4e4ed049dcba8a5adf8859fcc4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:39.055128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:39.312794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce9f2a4e4ed049dcba8a5adf8859fcc4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:39.313380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce9f2a4e4ed049dcba8a5adf8859fcc4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:39.326013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce9f2a4e4ed049dcba8a5adf8859fcc4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:39.326667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce9f2a4e4ed049dcba8a5adf8859fcc4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:39.386768 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce9f2a4e4ed049dcba8a5adf8859fcc4'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:39.399630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1375/2749] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 18:34:38 2022] DELETE /identity/v3/users/ce9f2a4e4ed049dcba8a5adf8859fcc4 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:34:39.404134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:39.404423 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:39.404700 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:39.424988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 18:34:39.426244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:39.486817 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1375/2750] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 18:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 18:34:39.496696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:39.498136 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:39.561390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59c6818-135b-46f6-ad38-324394c3f9e9 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:39.566755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:39.567319 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:39.567603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:39.567883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:39.577305 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:39.578767 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:39.589197 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1376/2751] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:34:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:34:39.999038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:39.999038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:40.004552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158753d-a66a-4dac-9a96-70c3b5c35868 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:40.009397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:40.010084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:40.010371 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:40.010648 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] PATH_INFO: `/v3/projects/1cc8334042e1427c9e02109f4d3f518c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:40.011810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1cc8334042e1427c9e02109f4d3f518c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:40.013872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:40.133910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1cc8334042e1427c9e02109f4d3f518c', 'request_id': 'req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:40.215137 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1cc8334042e1427c9e02109f4d3f518c', 'request_id': 'req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:40.221523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1cc8334042e1427c9e02109f4d3f518c', 'request_id': 'req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:40.232730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] The token cache is being invalidate because project 1cc8334042e1427c9e02109f4d3f518c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 18:34:40.233032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:40.233660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 18:34:40.235424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1376/2752] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 18:34:39 2022] DELETE /identity/v3/projects/1cc8334042e1427c9e02109f4d3f518c => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 18:34:46.904556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:34:46.906008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:46.932505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:46.963520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35f1f12-1b4f-419e-9169-d4d9a337074c service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:34:47.014941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:34:47.015580 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:34:47.017701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:34:47.017701 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:34:47.018800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:34:47.079288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:34:47.080990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:34:47.090883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1377/2753] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:34:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:34:50.229691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:34:57.086116 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=58 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:35:34.400471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:35:34.401978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:35:34.459498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e37ff2d-d6ee-4b59-b1fb-21845b79ca61 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:35:34.463084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:35:34.463698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:35:34.463981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:35:34.464255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:35:34.466039 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:35:34.475557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:35:34.476981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:35:34.485352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1377/2754] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:35:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:35:36.251866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:35:36.253353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:35:36.331992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87064aac-175a-4404-a964-2970052b70e9 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:35:36.337623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:35:36.338291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:35:36.338570 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:35:36.338837 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:35:36.341139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:35:36.353338 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:35:36.354977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:35:36.365394 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1378/2755] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:35:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:35:44.481589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=26 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:35:46.361075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=34 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:09.710649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:09.712450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:09.729131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d687cb7b-aa4b-4948-9a5a-5682958d89d8 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:09.734559 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:09.735164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:09.735444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:09.735718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:09.737400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:09.816258 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:09.817804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:09.837515 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1378/2756] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:19.834823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=41 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:38.068045 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:38.069584 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:38.137159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6839bdae-7147-45f3-bf8a-62a39e33de97 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:38.142451 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:38.143120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:38.143393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:38.143688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:38.145429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:38.156741 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:38.158333 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:38.168595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1379/2757] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:45.821211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:37:45.822709 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:45.835719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d2c55b-58d0-49bc-9efd-5afd0fef32ca service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:37:45.839506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:37:45.840145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:37:45.840516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:37:45.840814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:37:45.842595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:37:45.903341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:37:45.904775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:37:45.913676 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1379/2758] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:37:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:37:48.164390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=32 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:37:55.909664 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=28 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:28.989888 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:28.991383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:29.003945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a116f-e42a-406d-b92a-56367c2f5d21 service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:29.007509 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:29.008108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:29.008381 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:29.008648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:29.010459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:29.023546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:29.024938 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:29.036103 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1380/2759] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:30.140909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:30.150283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa70bf63-8c17-4179-a586-208c772a303a service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:30.153751 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:30.154384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:30.154654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:30.154922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:30.156694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:30.169974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:30.171378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:30.182797 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1380/2760] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:39.030866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:40.177809 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:39:47.828202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:39:47.829614 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:39:47.841286 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f007b-3f3c-4031-a93f-05b66fbc27d5 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:39:47.845363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:39:47.846006 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:39:47.846288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:39:47.846556 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:39:47.854714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:39:47.856122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:39:47.882940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1381/2761] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:39:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:39:57.880359 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=13 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:40:51.739250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:40:51.758347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0901f-b847-4041-91ff-1fa63c8f2e11 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:40:51.761964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:40:51.762595 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:40:51.762895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:40:51.763164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:40:51.770356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:40:51.771784 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:40:51.779707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1381/2762] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:40:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:41:01.776095 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=11 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:42:43.005942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:42:43.007363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:42:43.093204 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d020912d-862f-46d1-891f-25e033186ee0 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:42:43.099462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:42:43.100289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:42:43.100289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:42:43.100289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:42:43.109387 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:42:43.111060 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:42:43.121623 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1382/2763] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:42:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 18:42:46.974516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:42:46.993640 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1db5ef-f850-4558-b9f9-43da6b025b22 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:42:46.997246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:42:46.997895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:42:46.998177 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:42:46.998453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:42:47.007389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:42:47.008818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:42:47.036818 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1382/2764] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:42:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:42:47.084291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:42:47.093571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4414d637-98b2-42be-9a34-88a12198d0bf service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:42:47.097115 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:42:47.097710 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:42:47.098094 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:42:47.098369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:42:47.107123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:42:47.108601 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:42:47.118624 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1383/2765] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:42:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:42:57.034041 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=17 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:42:57.113585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=43 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:44:47.343235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:44:47.395638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6268f68-29fe-4120-98a6-4a61184bade5 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:44:47.399497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:44:47.400099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:44:47.400375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:44:47.400646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:44:47.418611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:44:47.420032 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:44:47.440391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1383/2766] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:44:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:44:47.447422 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:44:47.499236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457fc7af-a110-4ebe-9ee9-900ec7289b47 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:44:47.502840 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:44:47.503441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:44:47.503720 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:44:47.503993 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:44:47.506096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:44:47.578465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:44:47.579890 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:44:47.589453 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1384/2767] 10.222.0.67 () {60 vars in 1396 bytes} [Wed Jul 27 18:44:47 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:44:47.718303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:44:47.726992 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40ddb3f-8acd-4b53-af05-77c3743fd09f service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:44:47.730706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:44:47.731315 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:44:47.731596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:44:47.731871 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:44:47.742234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:44:47.743653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:44:47.755062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1384/2768] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:44:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:44:57.585113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=53 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:44:57.750182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=39 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:45:57.706576 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:45:57.708126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:57.785441 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaad0b8-c038-4e42-ba7c-d891e3e948a6 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:45:57.789088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:45:57.789696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:45:57.790003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:45:57.790272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:45:57.792096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:45:57.802129 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:45:57.803539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:45:57.811529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1385/2769] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:45:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:46:07.808240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=35 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:44.040596 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:44.112860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39836d1-3434-46fd-a330-cd5c867e2cb4 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:44.117850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61199f-033c-426e-a988-29824287b734 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:44.118468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61199f-033c-426e-a988-29824287b734 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:44.118747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61199f-033c-426e-a988-29824287b734 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:44.119020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61199f-033c-426e-a988-29824287b734 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:44.120872 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5a61199f-033c-426e-a988-29824287b734 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:44.132244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61199f-033c-426e-a988-29824287b734 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:44.133833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61199f-033c-426e-a988-29824287b734 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:44.143844 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1385/2770] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:46.962121 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:46.963702 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:47.050520 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba43451a-bc59-45cb-a582-d7ff46098415 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:47.055990 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:47.056599 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:47.056874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:47.057634 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:47.059492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:47.128922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:47.130549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:47.140425 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1386/2771] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:47.167507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61199f-033c-426e-a988-29824287b734 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:47:47.167507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61199f-033c-426e-a988-29824287b734 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:47:47.171255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:47:47.171904 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:47:47.172206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:47:47.172485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:47:47.174444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:47:47.257539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:47:47.259148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:47:47.279191 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1386/2772] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:47:47 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:47:57.135434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=66 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:47:57.275860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=73 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:47.884391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:47.893674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd0a91-1b0f-452b-b6c7-6f2356d59eb3 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:47.897269 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:47.897903 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:47.898185 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:47.898459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:47.900320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:49:47.914063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:47.915471 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:47.926571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1387/2773] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:49:48.191956 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:49:48.204526 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c0ec2-39ce-4d2b-87cd-bca0efdd338a service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:49:48.210067 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:49:48.210678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:49:48.210981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:49:48.211259 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:49:48.219252 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:49:48.220848 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:49:48.248570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1387/2774] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:49:48 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:49:57.921457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:49:58.245979 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=13 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:50:49.577110 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:49.578715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:49.592818 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e79d6-c888-453e-88ca-0e868a948c7e service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:49.598685 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:49.599298 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:49.599579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:49.599853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:49.601660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:49.614531 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:49.620462 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:49.627331 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1388/2775] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:49 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:50.095305 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:50:50.096898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:50.109173 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b14ca7-20c2-4c3c-af3a-be5f4bf5deb7 service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:50:50.112783 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:50:50.113399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:50:50.113679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:50:50.113988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:50:50.115833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:50:50.129925 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:50:50.131353 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:50:50.143374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1388/2776] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:50:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:50:59.622503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:00.138311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:51:00.687303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:51:00.696704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854d2b9-232f-4be7-a04c-ee4826e09f5c service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:51:00.700370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:51:00.700994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:51:00.701277 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:51:00.701547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:51:00.708793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:51:00.710254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:51:00.718718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1389/2777] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:51:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:51:10.715193 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:52:47.924875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:47.966749 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adb44b-18ea-482a-b3f1-8ea05fb16604 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:47.972340 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:47.972944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:47.973224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:47.973498 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:47.982303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:47.983889 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:48.010804 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1389/2778] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:48.853557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:48.855775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:48.915873 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd2a68-d219-4879-bc18-7c91b2699c7e service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:48.920108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:48.920707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:48.920982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:48.921248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:48.929476 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:48.930913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:48.939705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1390/2779] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:49.033740 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:49.035367 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:49.094417 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c94b199-3909-4876-b532-5c03b4380c3d service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:49.103523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:49.104944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:49.105682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:49.106065 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:49.117571 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:49.119325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:49.133020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1390/2780] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:50.184024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:52:50.197669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684f0fc-44dc-4626-b70f-2893ea5625bb service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:52:50.204245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:52:50.208301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:52:50.208301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:52:50.208301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:52:50.208301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:52:50.221638 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:52:50.223270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:52:50.235352 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1391/2781] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:52:50 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:52:59.127662 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=42 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:53:00.230159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=34 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:48.533830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:48.543525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e49c2aa-041f-4386-b4cd-46dd6af5f551 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:48.547213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:48.547811 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:48.548086 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:48.548355 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:48.566139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:48.567633 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:48.589260 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1391/2782] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:54:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:54:49.724154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:54:49.776442 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aea2bdd-9038-403e-811b-68ff1b7e631c service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:54:49.779994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:54:49.780596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:54:49.780870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:54:49.781139 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:54:49.782983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:54:49.850793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:54:49.852198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:54:49.860875 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1392/2783] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:54:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:54:58.586413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=13 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:54:59.856843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=53 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:55:51.278467 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:55:51.287523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b3aa8f-9d41-433c-972e-028abf0e7b84 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:55:51.291193 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:55:51.291794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:55:51.292075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:55:51.292352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:55:51.303496 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:55:51.304951 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:55:51.315918 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1392/2784] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:55:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:56:01.311034 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:56:07.658328 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:56:07.660014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:07.737595 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513560cf-3fba-4d20-bed1-f82b00f45b83 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:56:07.741399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:56:07.742051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:56:07.742336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:56:07.742608 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:56:07.744468 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:56:07.753960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:56:07.755918 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:56:07.763910 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1393/2785] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:56:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:56:17.760253 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=35 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:57:49.165907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:49.232654 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949d1a7-87e4-4cae-ae37-e2c365347fc3 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:49.238017 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:49.238646 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:49.238922 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:49.239188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:49.241014 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:49.317450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:49.319073 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:49.337610 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1393/2786] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:54.019104 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:57:54.020657 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:54.089994 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10400f6-99a5-4133-94e9-543ed3ba16c3 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:57:54.094929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3916541-8419-4646-89c3-7c409153062e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:57:54.095535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3916541-8419-4646-89c3-7c409153062e service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:57:54.095816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3916541-8419-4646-89c3-7c409153062e service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:57:54.096085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3916541-8419-4646-89c3-7c409153062e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:57:54.097953 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e3916541-8419-4646-89c3-7c409153062e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:57:54.109877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3916541-8419-4646-89c3-7c409153062e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:57:54.111459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3916541-8419-4646-89c3-7c409153062e service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:57:54.121287 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1394/2787] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:57:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:57:59.335000 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=69 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:04.117020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=32 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:58:50.268108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:58:50.277622 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfda56b-20f2-4a74-b3be-0dff7591015b service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:58:50.281974 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:58:50.282681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:58:50.283025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:58:50.283396 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:58:50.285304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:58:50.356853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:58:50.358409 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:58:50.367591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1394/2788] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:58:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:00.363289 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=33 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:48.389194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3916541-8419-4646-89c3-7c409153062e service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:48.399208 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3916541-8419-4646-89c3-7c409153062e service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:48.402806 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:48.403403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:48.403683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:48.403984 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:48.405925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:48.432108 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:48.433546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:48.444390 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1395/2789] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:49.573424 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 18:59:49.575026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 18:59:49.590335 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8adf032d-f02d-4e6b-8954-1c3a418ae7f9 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 18:59:49.595927 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 18:59:49.596528 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 18:59:49.596802 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 18:59:49.597071 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 18:59:49.605243 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 18:59:49.606822 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 18:59:49.633581 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1395/2790] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 18:59:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 18:59:58.439629 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=11 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 18:59:59.630991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=13 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:00:52.879672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:00:52.881327 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:00:52.892086 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81a2c8-31cc-43d5-8588-81ac475a35fb service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:00:52.895778 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:00:52.896412 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:00:52.896690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:00:52.896960 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:00:52.898759 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:00:52.912450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:00:52.913876 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:00:52.925012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1396/2791] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:00:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:01:02.920219 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:02:51.181876 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:02:51.183446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:02:51.249747 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108944ce-bee4-43aa-aa63-548873c62c28 service nova] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:02:51.253510 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:02:51.254162 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:51.254443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:51.254713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:51.276309 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:02:51.277682 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:02:51.287317 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1396/2792] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:02:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:02:53.138313 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:02:53.139978 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:02:53.209805 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93231bd-8dda-4732-960c-0f8d5748939c service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:02:53.215626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:02:53.216270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:02:53.216552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:02:53.216824 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:02:53.218715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:02:53.234142 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:02:53.235780 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:02:53.248199 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1397/2793] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:02:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:03:01.282413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=34 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:03:02.020720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:03:02.022521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:03:02.060200 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b4aa18-2da5-4eae-ad73-e8f61829a4b0 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:03:02.065178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:03:02.065821 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:03:02.072145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:03:02.072145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:03:02.075678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:03:02.077642 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:03:02.088724 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1397/2794] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:03:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:03:03.243340 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=28 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:03:12.084227 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=15 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:04:48.958207 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:48.969172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68262c21-147d-4e52-ab54-7f3ab3f16e15 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:48.972668 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:48.973267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:48.973543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:48.973844 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:48.992414 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:48.993797 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:49.015099 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1398/2795] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:04:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:04:49.022103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:49.036164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0021533b-fbdb-4f74-895c-946583b89420 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:49.039686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:49.040287 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:49.040561 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:49.040829 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:49.049895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:49.051336 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:49.060629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1398/2796] 10.222.0.67 () {60 vars in 1396 bytes} [Wed Jul 27 19:04:49 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:04:50.078223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:04:50.078223 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:04:50.139705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3407e22-a950-44e2-a3d8-5533aa043bc7 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:04:50.143247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:04:50.143949 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:04:50.144235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:04:50.144511 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:04:50.153062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:04:50.154529 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:04:50.182353 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1399/2797] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:04:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:04:59.056025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:00.179293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=46 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:39.277446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:39.286323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6673ce-350e-4378-ba4b-25b886876913 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:39.290755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:39.291359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:39.291638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:39.291909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:39.293691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:39.378743 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:39.380405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:39.401906 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1399/2798] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:40.065361 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:40.076220 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e9822-0a37-4b1c-8ab5-0189c93309f5 service cinder] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:40.079892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:40.080535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:40.080811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:40.081088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:40.083028 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:40.095728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:40.096973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:40.109949 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1400/2799] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:40.711255 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:40.723186 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c8cbf-dd87-417c-8671-41b45f16e7bf service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:40.728531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:40.729437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:40.729981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:40.730495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:40.732565 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:40.746441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:40.748850 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:40.769755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1400/2800] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:40.925656 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:40.927153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:40.942209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d30612-1c50-43fc-8e3c-05d6a61db1ba service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:40.946950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:40.947691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:40.947997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:40.948276 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] PATH_INFO: `/v3/users/724b68c33d1c49738f2bc1ad4291e496` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:40.949448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] RBAC: Authorizing `identity:delete_user(user_id=724b68c33d1c49738f2bc1ad4291e496)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:40.951501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:41.146393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '724b68c33d1c49738f2bc1ad4291e496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.147229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '724b68c33d1c49738f2bc1ad4291e496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.160803 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '724b68c33d1c49738f2bc1ad4291e496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.161594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '724b68c33d1c49738f2bc1ad4291e496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.237964 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '724b68c33d1c49738f2bc1ad4291e496'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.253549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1401/2801] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:05:40 2022] DELETE /identity/v3/users/724b68c33d1c49738f2bc1ad4291e496 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:41.638219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:41.649653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956500a8-c14a-4af8-9dd7-2a7cf23f0599 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:41.714594 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:41.715311 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:41.715511 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:41.716001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] PATH_INFO: `/v3/projects/616eb300f24646b8bfcec7a1c18f5b6e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:41.717202 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] RBAC: Authorizing `identity:delete_project(project_id=616eb300f24646b8bfcec7a1c18f5b6e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:41.719195 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:41.828887 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '616eb300f24646b8bfcec7a1c18f5b6e', 'request_id': 'req-630f47ee-1c65-479d-989a-13e8b84d331b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.832611 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:41.906603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '616eb300f24646b8bfcec7a1c18f5b6e', 'request_id': 'req-630f47ee-1c65-479d-989a-13e8b84d331b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.916677 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '616eb300f24646b8bfcec7a1c18f5b6e', 'request_id': 'req-630f47ee-1c65-479d-989a-13e8b84d331b'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.930026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] The token cache is being invalidate because project 616eb300f24646b8bfcec7a1c18f5b6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:05:41.930329 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.936115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:41.938219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1401/2802] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:05:41 2022] DELETE /identity/v3/projects/616eb300f24646b8bfcec7a1c18f5b6e => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:43.085018 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:43.087002 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:43.160481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d100e7-971b-4a13-bdfb-295a99bbd93e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:43.211440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:43.223479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:43.223479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:43.223479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:43.223802 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:43.228537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:43.229038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:43.231096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:43.241850 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:43.243508 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:43.254009 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1402/2803] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:43.300914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630f47ee-1c65-479d-989a-13e8b84d331b admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:43.305548 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:43.306218 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:43.306502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:43.306778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] PATH_INFO: `/v3/users/e571a6378a0240cfbe40f4cc63e0486d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:43.320215 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e571a6378a0240cfbe40f4cc63e0486d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:43.322839 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:43.547912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e571a6378a0240cfbe40f4cc63e0486d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:43.638053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e571a6378a0240cfbe40f4cc63e0486d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:43.645647 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e571a6378a0240cfbe40f4cc63e0486d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:43.660907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e571a6378a0240cfbe40f4cc63e0486d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:43.661602 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-65fb8718-0467-4e74-9827-461331235458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e571a6378a0240cfbe40f4cc63e0486d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:43.668105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1402/2804] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:05:43 2022] DELETE /identity/v3/users/e571a6378a0240cfbe40f4cc63e0486d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:43.925290 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:43.935902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2677e9ae-e5c2-4da7-bef9-4aac4de38b1b service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:43.995117 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:43.995739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:43.996020 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:43.996294 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] PATH_INFO: `/v3/projects/a1b1f6054abf4d8fbe5e629c86ea29c4` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:43.997470 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b1f6054abf4d8fbe5e629c86ea29c4)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:43.999401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:44.105042 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b1f6054abf4d8fbe5e629c86ea29c4', 'request_id': 'req-4cc28913-f887-433d-9175-e05f9d740815'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:44.110838 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b1f6054abf4d8fbe5e629c86ea29c4', 'request_id': 'req-4cc28913-f887-433d-9175-e05f9d740815'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:44.117206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b1f6054abf4d8fbe5e629c86ea29c4', 'request_id': 'req-4cc28913-f887-433d-9175-e05f9d740815'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:44.191250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] The token cache is being invalidate because project a1b1f6054abf4d8fbe5e629c86ea29c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:05:44.191534 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:44.192184 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-4cc28913-f887-433d-9175-e05f9d740815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:44.193706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1403/2805] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:05:43 2022] DELETE /identity/v3/projects/a1b1f6054abf4d8fbe5e629c86ea29c4 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:44.198699 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ce5be-dac3-4f50-b51d-bdd10a8c5a21 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.198989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ce5be-dac3-4f50-b51d-bdd10a8c5a21 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.199271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ce5be-dac3-4f50-b51d-bdd10a8c5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.257234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a47ce5be-dac3-4f50-b51d-bdd10a8c5a21 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:44.258544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a47ce5be-dac3-4f50-b51d-bdd10a8c5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:44.271446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:44.317427 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1403/2806] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:44.325402 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fce7-2c4c-46e4-8043-f2a6fce9243d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.325690 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fce7-2c4c-46e4-8043-f2a6fce9243d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.326029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a057fce7-2c4c-46e4-8043-f2a6fce9243d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.345868 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-a057fce7-2c4c-46e4-8043-f2a6fce9243d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:44.347069 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-a057fce7-2c4c-46e4-8043-f2a6fce9243d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:44.355755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1404/2807] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:44.360035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ce5be-dac3-4f50-b51d-bdd10a8c5a21 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:44.369570 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ce5be-dac3-4f50-b51d-bdd10a8c5a21 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:44.374188 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:44.374792 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.375074 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.375351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.376038 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:05:44.376342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:44.378035 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:44.389681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1404/2808] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 19:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:05:44.393865 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057fce7-2c4c-46e4-8043-f2a6fce9243d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:44.403465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a057fce7-2c4c-46e4-8043-f2a6fce9243d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:44.408090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:44.408683 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.408962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.409233 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.409923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:44.411793 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:44.553836 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1405/2809] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:05:44 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:05:44.558220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:44.568393 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93202953-2616-442d-9bed-0560cc9c48f8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:44.626061 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:44.626598 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.626879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.627150 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.627800 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:44.629888 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:44.731999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1405/2810] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:05:44 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:05:44.732925 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:44.743254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192746d3-1438-4bac-8ed8-2b316f84ea4f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:44.748008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:44.748619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.748895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.749166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.749971 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:44.751549 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:44.762311 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1406/2811] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:05:44.766321 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:44.776833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea8697-e87d-40ec-9189-443d374947fb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:44.781406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123d778-fb0c-454e-b7ee-a01fc6909e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:44.782033 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123d778-fb0c-454e-b7ee-a01fc6909e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.782314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123d778-fb0c-454e-b7ee-a01fc6909e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.782583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123d778-fb0c-454e-b7ee-a01fc6909e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.783261 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123d778-fb0c-454e-b7ee-a01fc6909e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:44.784830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123d778-fb0c-454e-b7ee-a01fc6909e66 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:44.795210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1406/2812] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:05:44.799203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:44.809112 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38461d75-d6af-4dba-84c4-d91139db1251 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:44.813796 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:44.814436 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.814718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.814995 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] PATH_INFO: `/v3/projects/a9ff6d6f7c47497d847bcf35e3733b3e/users/4861a0ba85f34cd4a9d825280736848c/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.829853 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ff6d6f7c47497d847bcf35e3733b3e, user_id=4861a0ba85f34cd4a9d825280736848c, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:44.832461 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:44.905014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1407/2813] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:05:44 2022] PUT /identity/v3/projects/a9ff6d6f7c47497d847bcf35e3733b3e/users/4861a0ba85f34cd4a9d825280736848c/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:05:44.916413 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f33d0-1a2d-46e8-aa23-c0daf844c6e8 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:44.916694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f33d0-1a2d-46e8-aa23-c0daf844c6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:44.916964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642f33d0-1a2d-46e8-aa23-c0daf844c6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:44.943965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-642f33d0-1a2d-46e8-aa23-c0daf844c6e8 None None] MFA Rules not processed for user `4861a0ba85f34cd4a9d825280736848c`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:44.945170 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-642f33d0-1a2d-46e8-aa23-c0daf844c6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:45.009547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1407/2814] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:05:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:45.014000 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:45.024303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:45.074672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a41193-35e7-4745-a759-9e370450f620 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:45.079245 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:45.079848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.080124 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.080393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.081048 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:45.083080 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:45.177024 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1408/2815] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:05:45 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:05:45.181566 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f33d0-1a2d-46e8-aa23-c0daf844c6e8 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:45.192155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642f33d0-1a2d-46e8-aa23-c0daf844c6e8 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:45.204115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:45.249209 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:45.250054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.250517 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.251194 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.251863 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:45.253823 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:45.333738 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1408/2816] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:05:45 2022] POST /identity/v3/users => generated 297 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:05:45.337880 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:45.348354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b10427-ab82-48e8-8a14-691f13ddfb48 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:45.353154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:45.353788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.354073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.354348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.355122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:45.356713 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:45.367344 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1409/2817] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:05:45.371967 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:45.381955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d251196-9a1b-4cdc-abee-e0a6540a90b8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:45.387462 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:45.388112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.388392 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.388698 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] PATH_INFO: `/v3/projects/d154ee81e28c434185dfd5bfc537b758/users/f2690d1990c8480a94b75297faaaea34/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.403120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d154ee81e28c434185dfd5bfc537b758, user_id=f2690d1990c8480a94b75297faaaea34, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:45.405759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:45.569437 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1409/2818] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:05:45 2022] PUT /identity/v3/projects/d154ee81e28c434185dfd5bfc537b758/users/f2690d1990c8480a94b75297faaaea34/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:45.573492 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:45.583481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bff037-f13a-4065-bf4e-3e6b7dd2803a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:45.639391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61cdbf-506f-4bc3-887f-6a8fc999e4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:45.640025 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61cdbf-506f-4bc3-887f-6a8fc999e4eb admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.640300 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61cdbf-506f-4bc3-887f-6a8fc999e4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.640567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61cdbf-506f-4bc3-887f-6a8fc999e4eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.641241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61cdbf-506f-4bc3-887f-6a8fc999e4eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:45.642863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61cdbf-506f-4bc3-887f-6a8fc999e4eb admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:45.652230 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1410/2819] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 27 19:05:45.656266 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:45.667062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd42cce-bdf2-4577-84c5-7360c2470f3e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:45.671705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:45.672358 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.672637 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.672910 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] PATH_INFO: `/v3/projects/d154ee81e28c434185dfd5bfc537b758/users/f2690d1990c8480a94b75297faaaea34/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.674891 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d154ee81e28c434185dfd5bfc537b758, user_id=f2690d1990c8480a94b75297faaaea34, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:45.677516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:45.688122 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1410/2820] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:05:45 2022] PUT /identity/v3/projects/d154ee81e28c434185dfd5bfc537b758/users/f2690d1990c8480a94b75297faaaea34/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:45.698111 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf943-6ab8-4b09-87d6-fa05df4dd842 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.698393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf943-6ab8-4b09-87d6-fa05df4dd842 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.698663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecaf943-6ab8-4b09-87d6-fa05df4dd842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.725128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9ecaf943-6ab8-4b09-87d6-fa05df4dd842 None None] MFA Rules not processed for user `f2690d1990c8480a94b75297faaaea34`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:45.726345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9ecaf943-6ab8-4b09-87d6-fa05df4dd842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:45.798677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1411/2821] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:05:45 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:45.809838 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:45.811519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:45.868063 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74feb2e-2c52-4b81-8ac7-9b979fe7f720 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:45.871621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:45.872225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:45.872504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:45.872779 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:45.881649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:45.883103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:45.892796 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1411/2822] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:46.130161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf943-6ab8-4b09-87d6-fa05df4dd842 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:46.137183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:46.141364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecaf943-6ab8-4b09-87d6-fa05df4dd842 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:46.145071 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b723a00-8803-44fa-9717-ca7e0417c02c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:46.145687 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723a00-8803-44fa-9717-ca7e0417c02c service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:46.145996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723a00-8803-44fa-9717-ca7e0417c02c service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:46.146273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b723a00-8803-44fa-9717-ca7e0417c02c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:46.202096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b723a00-8803-44fa-9717-ca7e0417c02c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:46.203942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b723a00-8803-44fa-9717-ca7e0417c02c service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:46.213312 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1412/2823] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:55.888638 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=63,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:56.232254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=26 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:57.796860 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:57.857588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2470e6-d229-46b9-b3ad-5a5af16a93fe service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:57.862521 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:57.863164 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:57.863446 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:57.863719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] PATH_INFO: `/v3/users/4861a0ba85f34cd4a9d825280736848c` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:57.864879 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4861a0ba85f34cd4a9d825280736848c)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:57.866934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:58.064448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4861a0ba85f34cd4a9d825280736848c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:58.159234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4861a0ba85f34cd4a9d825280736848c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:58.166684 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4861a0ba85f34cd4a9d825280736848c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:58.179157 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4861a0ba85f34cd4a9d825280736848c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:58.179799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4861a0ba85f34cd4a9d825280736848c'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:58.185643 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1412/2824] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:05:57 2022] DELETE /identity/v3/users/4861a0ba85f34cd4a9d825280736848c => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:58.192689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:58.192689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:58.192689 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:58.209075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:05:58.210246 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:58.269596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1413/2825] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:05:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:05:58.279851 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:58.281250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:58.337497 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4268f3a-0062-4dd8-a1ea-0369ed15c8c8 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:58.341054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:58.342211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:58.342495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:58.342769 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:58.351694 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:58.354290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:58.363140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1413/2826] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:05:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:05:58.755603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:58.757154 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:58.770085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15ebcae-d3af-41e8-a53f-76d96fad16ba None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:58.776295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:58.777408 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:58.777786 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:58.778198 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] PATH_INFO: `/v3/projects/a9ff6d6f7c47497d847bcf35e3733b3e` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:58.780161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ff6d6f7c47497d847bcf35e3733b3e)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:58.783092 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:58.902870 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ff6d6f7c47497d847bcf35e3733b3e', 'request_id': 'req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:58.908295 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ff6d6f7c47497d847bcf35e3733b3e', 'request_id': 'req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:58.914415 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ff6d6f7c47497d847bcf35e3733b3e', 'request_id': 'req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.009969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] The token cache is being invalidate because project a9ff6d6f7c47497d847bcf35e3733b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:05:59.010254 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.011122 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.012661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1414/2827] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:05:58 2022] DELETE /identity/v3/projects/a9ff6d6f7c47497d847bcf35e3733b3e => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:59.017378 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:59.027048 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd1d1b9-4927-471d-82d6-f0f958111700 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:59.044667 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:05:59.083370 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:59.084012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:59.084294 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:59.084569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] PATH_INFO: `/v3/users/f2690d1990c8480a94b75297faaaea34` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:59.085722 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2690d1990c8480a94b75297faaaea34)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:59.087671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:05:59.315725 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2690d1990c8480a94b75297faaaea34'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.391717 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2690d1990c8480a94b75297faaaea34'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.398786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2690d1990c8480a94b75297faaaea34'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.410983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2690d1990c8480a94b75297faaaea34'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.411650 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-4870e58f-6abe-4bf2-ab64-0e2dfdfc9b6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2690d1990c8480a94b75297faaaea34'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:05:59.417469 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1414/2828] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:05:59 2022] DELETE /identity/v3/users/f2690d1990c8480a94b75297faaaea34 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:05:59.829400 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:05:59.831073 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:05:59.845090 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb4ee7-4e0b-4903-8789-b1ca88037c3a admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:05:59.903466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:05:59.904106 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:05:59.904389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:05:59.904663 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] PATH_INFO: `/v3/projects/d154ee81e28c434185dfd5bfc537b758` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:05:59.906466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d154ee81e28c434185dfd5bfc537b758)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:05:59.908459 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:00.010444 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:00.026843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd154ee81e28c434185dfd5bfc537b758', 'request_id': 'req-d2c00ce9-deda-4c93-b7c8-7101eacabfff'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:00.032948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd154ee81e28c434185dfd5bfc537b758', 'request_id': 'req-d2c00ce9-deda-4c93-b7c8-7101eacabfff'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:00.039200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd154ee81e28c434185dfd5bfc537b758', 'request_id': 'req-d2c00ce9-deda-4c93-b7c8-7101eacabfff'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:00.118950 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] The token cache is being invalidate because project d154ee81e28c434185dfd5bfc537b758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:06:00.124581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:00.124581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d2c00ce9-deda-4c93-b7c8-7101eacabfff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:00.124581 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1415/2829] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:05:59 2022] DELETE /identity/v3/projects/d154ee81e28c434185dfd5bfc537b758 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:00.126501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9f9a-3493-48ad-90c6-860ee6d6bc3b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.126980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9f9a-3493-48ad-90c6-860ee6d6bc3b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.127087 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a9f9a-3493-48ad-90c6-860ee6d6bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.147584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-712a9f9a-3493-48ad-90c6-860ee6d6bc3b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:00.151712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-712a9f9a-3493-48ad-90c6-860ee6d6bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:00.207938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1415/2830] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:06:00.217019 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a497f83-1ed4-4b1c-ad22-ccad4f1f61d2 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.217299 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a497f83-1ed4-4b1c-ad22-ccad4f1f61d2 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.217571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a497f83-1ed4-4b1c-ad22-ccad4f1f61d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.237775 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7a497f83-1ed4-4b1c-ad22-ccad4f1f61d2 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:00.239003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7a497f83-1ed4-4b1c-ad22-ccad4f1f61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:00.246926 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1416/2831] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:00.251554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a9f9a-3493-48ad-90c6-860ee6d6bc3b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:00.261653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a9f9a-3493-48ad-90c6-860ee6d6bc3b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:00.267075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:00.267687 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.267998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.268273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.268965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:06:00.269273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:00.270915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:00.282408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1416/2832] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 19:06:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:06:00.286816 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a497f83-1ed4-4b1c-ad22-ccad4f1f61d2 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:00.295928 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a497f83-1ed4-4b1c-ad22-ccad4f1f61d2 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:00.300563 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:00.301164 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.301445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.301717 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.302411 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:00.304292 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:00.423564 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1417/2833] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:06:00 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:06:00.427828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:00.438381 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6e7b80-d7a7-4daa-8db3-b35feb611a9f admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:00.464304 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:00.494846 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:00.495495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.495981 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.496449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.497540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:00.499516 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:00.666901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1417/2834] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:06:00 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:00.670947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:00.683483 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2157f3d9-2c93-4c25-a5b4-f13b2f7d5004 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:00.686392 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:00.687005 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.687930 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.688203 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.688895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:00.690561 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:00.700704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1418/2835] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:00.704604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:00.714575 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2b301-4664-4db6-9b9e-10d125a1d3c4 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:00.719148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e19d74a-a80c-4b9e-91bd-b7176b2022f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:00.723830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19d74a-a80c-4b9e-91bd-b7176b2022f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.723830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19d74a-a80c-4b9e-91bd-b7176b2022f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.723830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e19d74a-a80c-4b9e-91bd-b7176b2022f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.723830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19d74a-a80c-4b9e-91bd-b7176b2022f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:00.723830 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e19d74a-a80c-4b9e-91bd-b7176b2022f5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:00.732412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1418/2836] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:00.737127 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:00.746856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e317092-378e-4f49-b0ef-b1ec5d5b2d7d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:00.752034 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:00.755616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.755616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.755616 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] PATH_INFO: `/v3/projects/bd44b6418445423984d8268898e943fc/users/0dcfd5fc1be543efb4acf6e352dbe5fe/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.767860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd44b6418445423984d8268898e943fc, user_id=0dcfd5fc1be543efb4acf6e352dbe5fe, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:00.770552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:00.868160 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1419/2837] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:00 2022] PUT /identity/v3/projects/bd44b6418445423984d8268898e943fc/users/0dcfd5fc1be543efb4acf6e352dbe5fe/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:00.879279 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388918-d5ea-4fb9-a5e9-d11d0a8511f0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:00.879572 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388918-d5ea-4fb9-a5e9-d11d0a8511f0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:00.879851 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b388918-d5ea-4fb9-a5e9-d11d0a8511f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:00.907307 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-4b388918-d5ea-4fb9-a5e9-d11d0a8511f0 None None] MFA Rules not processed for user `0dcfd5fc1be543efb4acf6e352dbe5fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:00.910608 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4b388918-d5ea-4fb9-a5e9-d11d0a8511f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:00.972330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1419/2838] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:00.976851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:01.038465 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a4e02-d810-4b83-9a9f-f608002287a6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:01.043214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:01.043822 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.044101 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.044373 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.045038 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:01.047575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:01.144497 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1420/2839] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:06:00 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:01.148686 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b388918-d5ea-4fb9-a5e9-d11d0a8511f0 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:01.159577 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b388918-d5ea-4fb9-a5e9-d11d0a8511f0 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:01.215332 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:01.215944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.216220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.216490 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.217151 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:01.219082 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:01.324973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1420/2840] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:06:01 2022] POST /identity/v3/users => generated 295 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:01.329719 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:01.340097 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c05bd50-a9f0-4bc5-a927-c5865384de39 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:01.344655 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:01.345315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.345594 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.345902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.346630 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:01.348211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:01.358575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1421/2841] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:01.362583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:01.372552 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1660ef-411c-42ec-b8d7-daefcfef376e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:01.378066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:01.378718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.379002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.379310 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] PATH_INFO: `/v3/projects/a42cf59268664e3486ceb8482640b143/users/a26243c9a1b2448bb36784028039718d/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.394789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42cf59268664e3486ceb8482640b143, user_id=a26243c9a1b2448bb36784028039718d, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:01.397436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:01.473391 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1421/2842] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:01 2022] PUT /identity/v3/projects/a42cf59268664e3486ceb8482640b143/users/a26243c9a1b2448bb36784028039718d/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:01.477238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:01.487764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad0f79f-cc58-411f-a9b7-ce874d9ccf0d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:01.508756 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:01.544929 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324951aa-5141-41a9-a282-0fe959b47868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:01.545567 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324951aa-5141-41a9-a282-0fe959b47868 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.545881 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324951aa-5141-41a9-a282-0fe959b47868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.546157 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324951aa-5141-41a9-a282-0fe959b47868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.547437 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324951aa-5141-41a9-a282-0fe959b47868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:01.549916 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324951aa-5141-41a9-a282-0fe959b47868 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:01.559633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1422/2843] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:01 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:01.564870 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:01.570359 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:01.575713 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18de7ec9-7386-4d0b-bdd0-e6e890a00e82 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:01.580854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:01.581388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.581669 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.581980 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] PATH_INFO: `/v3/projects/a42cf59268664e3486ceb8482640b143/users/a26243c9a1b2448bb36784028039718d/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.583938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42cf59268664e3486ceb8482640b143, user_id=a26243c9a1b2448bb36784028039718d, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:01.586609 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:01.597240 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1422/2844] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:01 2022] PUT /identity/v3/projects/a42cf59268664e3486ceb8482640b143/users/a26243c9a1b2448bb36784028039718d/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:01.607682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3f7d-83eb-4d00-b8bc-1d68c0b57004 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.608062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3f7d-83eb-4d00-b8bc-1d68c0b57004 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.608640 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a3f7d-83eb-4d00-b8bc-1d68c0b57004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.640011 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-355a3f7d-83eb-4d00-b8bc-1d68c0b57004 None None] MFA Rules not processed for user `a26243c9a1b2448bb36784028039718d`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:01.641315 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-355a3f7d-83eb-4d00-b8bc-1d68c0b57004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:01.708147 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1423/2845] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:01.718681 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:01.720369 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:01.777550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b50d6b-8abf-48cf-93b1-b9334fbc8d44 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:01.781832 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:01.782458 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:01.782742 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:01.783019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:01.838050 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:01.839449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:01.848744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1423/2846] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:06:08.167337 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3f7d-83eb-4d00-b8bc-1d68c0b57004 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:08.177478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a3f7d-83eb-4d00-b8bc-1d68c0b57004 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:08.181259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e4d449-481c-4a12-ad76-fb667b51e071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:08.181945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d449-481c-4a12-ad76-fb667b51e071 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:08.182227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d449-481c-4a12-ad76-fb667b51e071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:08.182521 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e4d449-481c-4a12-ad76-fb667b51e071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:08.192194 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4d449-481c-4a12-ad76-fb667b51e071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:08.193607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e4d449-481c-4a12-ad76-fb667b51e071 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:08.202991 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1424/2847] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:06:11.844755 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=52,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:18.198882 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=58 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:35.551414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:35.613084 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503570fe-aba2-4b3b-85c5-f119de26c37a service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:35.617660 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:35.618362 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:35.618645 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:35.618920 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] PATH_INFO: `/v3/users/0dcfd5fc1be543efb4acf6e352dbe5fe` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:35.620103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=0dcfd5fc1be543efb4acf6e352dbe5fe)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:35.622104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:35.796042 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0dcfd5fc1be543efb4acf6e352dbe5fe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:35.882704 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0dcfd5fc1be543efb4acf6e352dbe5fe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:35.890451 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0dcfd5fc1be543efb4acf6e352dbe5fe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:35.902406 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0dcfd5fc1be543efb4acf6e352dbe5fe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:35.903053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0dcfd5fc1be543efb4acf6e352dbe5fe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:35.909026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1424/2848] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:06:35 2022] DELETE /identity/v3/users/0dcfd5fc1be543efb4acf6e352dbe5fe => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:35.913488 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:35.913973 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:35.914054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:35.932272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:35.933447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:35.990667 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1425/2849] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:36.001006 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:36.002444 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:36.079999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714a790-2bf7-452d-891d-dd0cdecd43fc admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:36.083663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:36.084271 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:36.084554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:36.084828 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:36.093719 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:36.095182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:36.104966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1425/2850] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:06:36.521823 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:36.523354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:36.538051 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895dca7-0e64-4c18-bfaa-9bdb80f0e0cc None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:36.543535 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:36.544264 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:36.552004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:36.552004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] PATH_INFO: `/v3/projects/bd44b6418445423984d8268898e943fc` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:36.552004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd44b6418445423984d8268898e943fc)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:36.552004 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:36.702769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd44b6418445423984d8268898e943fc', 'request_id': 'req-d4de89df-453e-4a80-bcb9-756d42f66719'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:36.709049 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd44b6418445423984d8268898e943fc', 'request_id': 'req-d4de89df-453e-4a80-bcb9-756d42f66719'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:36.715423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd44b6418445423984d8268898e943fc', 'request_id': 'req-d4de89df-453e-4a80-bcb9-756d42f66719'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:36.813054 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] The token cache is being invalidate because project bd44b6418445423984d8268898e943fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:06:36.813339 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:36.813997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:36.815546 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1426/2851] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:06:36 2022] DELETE /identity/v3/projects/bd44b6418445423984d8268898e943fc => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:06:36.819593 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:36.824354 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:36.830025 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274dbee7-eb72-411b-8b5d-d1f701ce851e service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:36.884504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:36.885144 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:36.885418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:36.885689 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] PATH_INFO: `/v3/users/a26243c9a1b2448bb36784028039718d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:36.886909 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a26243c9a1b2448bb36784028039718d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:36.889988 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:37.047485 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a26243c9a1b2448bb36784028039718d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.131859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a26243c9a1b2448bb36784028039718d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.140126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a26243c9a1b2448bb36784028039718d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.152124 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a26243c9a1b2448bb36784028039718d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.152775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-b947795f-c7d8-4229-ba96-06ec9f724ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a26243c9a1b2448bb36784028039718d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.158998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1426/2852] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:06:36 2022] DELETE /identity/v3/users/a26243c9a1b2448bb36784028039718d => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:37.570235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:37.571769 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:37.586712 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4de89df-453e-4a80-bcb9-756d42f66719 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:37.646271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:37.646908 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:37.647188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:37.647454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] PATH_INFO: `/v3/projects/a42cf59268664e3486ceb8482640b143` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:37.648597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42cf59268664e3486ceb8482640b143)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:37.650543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:37.729562 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:37.745893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42cf59268664e3486ceb8482640b143', 'request_id': 'req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.751948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42cf59268664e3486ceb8482640b143', 'request_id': 'req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.757962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42cf59268664e3486ceb8482640b143', 'request_id': 'req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.839457 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] The token cache is being invalidate because project a42cf59268664e3486ceb8482640b143 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:06:37.839680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.840314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-c2af084d-fa81-4ea9-8483-a9ae5fa0575e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:37.841889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1427/2853] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:06:37 2022] DELETE /identity/v3/projects/a42cf59268664e3486ceb8482640b143 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:37.846950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db79d5-e132-4b7a-adce-3e54c601b059 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:37.847411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db79d5-e132-4b7a-adce-3e54c601b059 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:37.847494 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08db79d5-e132-4b7a-adce-3e54c601b059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:37.868495 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-08db79d5-e132-4b7a-adce-3e54c601b059 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:37.870489 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-08db79d5-e132-4b7a-adce-3e54c601b059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:37.929389 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1427/2854] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:37.937188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381270-f261-4523-aa2f-bc3630defeb5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:37.937472 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381270-f261-4523-aa2f-bc3630defeb5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:37.937749 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92381270-f261-4523-aa2f-bc3630defeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:37.956941 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-92381270-f261-4523-aa2f-bc3630defeb5 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:37.958174 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-92381270-f261-4523-aa2f-bc3630defeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:37.966079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1428/2855] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:37.970940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db79d5-e132-4b7a-adce-3e54c601b059 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:37.980523 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08db79d5-e132-4b7a-adce-3e54c601b059 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:37.985652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:37.986300 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:37.986585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:37.986862 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:37.987550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:06:37.987858 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:37.989461 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.002013 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1428/2856] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 19:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:06:38.006241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92381270-f261-4523-aa2f-bc3630defeb5 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.016666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92381270-f261-4523-aa2f-bc3630defeb5 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.021364 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.022081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.022362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.022631 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.023291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.025252 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.095585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1429/2857] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:06:38 2022] POST /identity/v3/projects => generated 401 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 27 19:06:38.099707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.110712 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c53549-bb3c-488f-bf2c-9a38c529d723 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.116514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:38.167268 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.167884 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.168179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.168448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.169096 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.171706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.266759 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1429/2858] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:06:38 2022] POST /identity/v3/users => generated 301 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:38.271301 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.282238 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8f4b9f-90a5-479e-a3c7-096aa85c8cf0 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.286959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.287596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.287877 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.288151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.288835 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.290478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.300430 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1430/2859] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:38.304377 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.314563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3844ae-8680-40e9-ac37-5566e03b6585 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.319405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac184973-e52b-4784-9776-34f4dbd3b2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.320007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac184973-e52b-4784-9776-34f4dbd3b2c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.320288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac184973-e52b-4784-9776-34f4dbd3b2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.320563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac184973-e52b-4784-9776-34f4dbd3b2c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.321285 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac184973-e52b-4784-9776-34f4dbd3b2c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.323204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac184973-e52b-4784-9776-34f4dbd3b2c5 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.335941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1430/2860] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:38.339947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.350661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ea5ed-83d1-4622-a57b-110efe8112cf admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.355227 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.355874 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.356153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.356427 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] PATH_INFO: `/v3/projects/dd9938ba4b37420286576e77604b9127/users/1a69ae2cd0304ac6ad59160638c59831/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.370669 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd9938ba4b37420286576e77604b9127, user_id=1a69ae2cd0304ac6ad59160638c59831, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.373857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.434639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1431/2861] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:38 2022] PUT /identity/v3/projects/dd9938ba4b37420286576e77604b9127/users/1a69ae2cd0304ac6ad59160638c59831/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:38.445182 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732fab-f85f-438f-b618-bbb61c4acce3 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.445536 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732fab-f85f-438f-b618-bbb61c4acce3 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.445852 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e732fab-f85f-438f-b618-bbb61c4acce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.475414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-8e732fab-f85f-438f-b618-bbb61c4acce3 None None] MFA Rules not processed for user `1a69ae2cd0304ac6ad59160638c59831`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:38.476620 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8e732fab-f85f-438f-b618-bbb61c4acce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:38.547133 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1431/2862] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:38 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:38.551672 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.613280 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70094d2-09fc-4fcb-9a50-4d1d239d6d9c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.617966 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.618565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.618846 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.619120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.619774 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.621666 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.716314 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1432/2863] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:06:38 2022] POST /identity/v3/projects => generated 401 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:38.720323 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732fab-f85f-438f-b618-bbb61c4acce3 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.731076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e732fab-f85f-438f-b618-bbb61c4acce3 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.787411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.788057 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.788342 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.788619 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.789291 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.791262 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.898966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1432/2864] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:06:38 2022] POST /identity/v3/users => generated 307 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:38.902224 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.912677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de18ef4-b509-43ef-8cf3-7427f76e4189 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.917405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.918052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.918336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.918611 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.919296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.920889 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:38.931502 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1433/2865] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:38.936104 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:38.946066 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854db7e0-6710-4b59-9c43-c86caa6f31a3 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:38.951267 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:38.951958 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:38.952238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:38.952514 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] PATH_INFO: `/v3/projects/58d46748e34f4a8485771b77393f0105/users/15fde99d11c74eb4aa4bb206eabc1b37/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:38.954767 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:38.967472 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d46748e34f4a8485771b77393f0105, user_id=15fde99d11c74eb4aa4bb206eabc1b37, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:38.970179 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:39.042557 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1433/2866] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:38 2022] PUT /identity/v3/projects/58d46748e34f4a8485771b77393f0105/users/15fde99d11c74eb4aa4bb206eabc1b37/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:39.047270 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:39.057355 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0f35d-71d1-4ef3-a94f-4bd3d1d79dd7 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:39.077479 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:39.113647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887a69d-140b-459b-9e97-9306809806ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:39.114293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a69d-140b-459b-9e97-9306809806ad admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:39.114575 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a69d-140b-459b-9e97-9306809806ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:39.114856 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887a69d-140b-459b-9e97-9306809806ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:39.115547 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887a69d-140b-459b-9e97-9306809806ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:39.117320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887a69d-140b-459b-9e97-9306809806ad admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:39.128647 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1434/2867] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:39 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:39.132791 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:39.143491 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3581594b-0cb3-46ab-87ce-af6786e091d9 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:39.148175 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:39.148854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:39.149184 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:39.149411 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] PATH_INFO: `/v3/projects/58d46748e34f4a8485771b77393f0105/users/15fde99d11c74eb4aa4bb206eabc1b37/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:39.151410 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58d46748e34f4a8485771b77393f0105, user_id=15fde99d11c74eb4aa4bb206eabc1b37, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:39.154103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:39.164226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1434/2868] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:39 2022] PUT /identity/v3/projects/58d46748e34f4a8485771b77393f0105/users/15fde99d11c74eb4aa4bb206eabc1b37/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:39.175695 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6be8-6015-4aa4-9917-a3e3261b62d8 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:39.175982 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6be8-6015-4aa4-9917-a3e3261b62d8 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:39.176260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6be8-6015-4aa4-9917-a3e3261b62d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:39.204571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-0c2f6be8-6015-4aa4-9917-a3e3261b62d8 None None] MFA Rules not processed for user `15fde99d11c74eb4aa4bb206eabc1b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:39.205821 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-0c2f6be8-6015-4aa4-9917-a3e3261b62d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:39.272320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1435/2869] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:39.282901 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:39.284588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:39.341357 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2d19e8-07d0-4a4e-b2b8-385946bb9975 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:39.345021 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:39.345628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:39.345944 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:39.346217 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:39.355046 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:39.356463 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:39.366250 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1435/2870] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:06:39.566754 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6be8-6015-4aa4-9917-a3e3261b62d8 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:39.576763 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6be8-6015-4aa4-9917-a3e3261b62d8 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:39.580391 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f658c52-d791-4518-acad-0f6a1ceeead5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:39.581001 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f658c52-d791-4518-acad-0f6a1ceeead5 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:39.581283 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f658c52-d791-4518-acad-0f6a1ceeead5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:39.581557 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f658c52-d791-4518-acad-0f6a1ceeead5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:39.637582 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f658c52-d791-4518-acad-0f6a1ceeead5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:39.639356 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f658c52-d791-4518-acad-0f6a1ceeead5 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:39.648480 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1436/2871] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:39 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:06:44.786727 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:44.850970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fb7d3c-89fe-43e7-9e36-05c1f089986e service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:44.855499 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:44.856131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:44.856408 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:44.856697 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] PATH_INFO: `/v3/users/1a69ae2cd0304ac6ad59160638c59831` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:44.857934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a69ae2cd0304ac6ad59160638c59831)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:44.859810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:45.036388 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a69ae2cd0304ac6ad59160638c59831'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.111540 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a69ae2cd0304ac6ad59160638c59831'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.119053 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a69ae2cd0304ac6ad59160638c59831'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.127873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:45.132776 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a69ae2cd0304ac6ad59160638c59831'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.133439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a69ae2cd0304ac6ad59160638c59831'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.139626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1436/2872] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:06:44 2022] DELETE /identity/v3/users/1a69ae2cd0304ac6ad59160638c59831 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:45.144013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:45.144466 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:45.144545 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:45.163070 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:45.165485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:45.204369 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=100 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:45.222259 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1437/2873] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:45.231933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:45.233914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:45.294853 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8905ad8-e614-4aad-9f0a-7bf0dec9fdeb admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:45.298929 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:45.299550 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:45.299859 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:45.300134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:45.308854 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:45.310326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:45.320292 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1437/2874] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:06:45.726792 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:45.728209 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:45.745113 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e135fecd-06ee-4d2c-9eab-9fe97cb78ec4 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:45.749855 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:45.750499 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:45.750777 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:45.751050 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] PATH_INFO: `/v3/projects/dd9938ba4b37420286576e77604b9127` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:45.752229 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd9938ba4b37420286576e77604b9127)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:45.754167 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:45.876008 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd9938ba4b37420286576e77604b9127', 'request_id': 'req-85e8a26e-dc00-4c07-8a17-fd67938877ed'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.881848 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd9938ba4b37420286576e77604b9127', 'request_id': 'req-85e8a26e-dc00-4c07-8a17-fd67938877ed'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.888536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd9938ba4b37420286576e77604b9127', 'request_id': 'req-85e8a26e-dc00-4c07-8a17-fd67938877ed'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.965811 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] The token cache is being invalidate because project dd9938ba4b37420286576e77604b9127 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:06:45.966102 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.966727 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:45.968945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1438/2875] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:06:45 2022] DELETE /identity/v3/projects/dd9938ba4b37420286576e77604b9127 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:45.972973 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:45.982586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21280888-1f38-43a5-ab46-167820c6d7b6 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:46.039504 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:46.040199 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:46.040483 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:46.040760 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] PATH_INFO: `/v3/users/15fde99d11c74eb4aa4bb206eabc1b37` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:46.042020 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15fde99d11c74eb4aa4bb206eabc1b37)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:46.043965 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:46.225069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15fde99d11c74eb4aa4bb206eabc1b37'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.286155 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15fde99d11c74eb4aa4bb206eabc1b37'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.293326 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15fde99d11c74eb4aa4bb206eabc1b37'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.305652 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15fde99d11c74eb4aa4bb206eabc1b37'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.306403 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-174da8fb-00bc-423d-9a66-bb9113a8e6c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15fde99d11c74eb4aa4bb206eabc1b37'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.312786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1438/2876] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:06:45 2022] DELETE /identity/v3/users/15fde99d11c74eb4aa4bb206eabc1b37 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:46.701804 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:46.703351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:46.718434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e8a26e-dc00-4c07-8a17-fd67938877ed admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:46.777779 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:46.778445 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:46.778753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:46.779021 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] PATH_INFO: `/v3/projects/58d46748e34f4a8485771b77393f0105` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:46.780159 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=58d46748e34f4a8485771b77393f0105)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:46.782123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:46.893358 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58d46748e34f4a8485771b77393f0105', 'request_id': 'req-467593ce-4bb2-45b0-888e-af2c806a81eb'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.899389 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58d46748e34f4a8485771b77393f0105', 'request_id': 'req-467593ce-4bb2-45b0-888e-af2c806a81eb'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.907039 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58d46748e34f4a8485771b77393f0105', 'request_id': 'req-467593ce-4bb2-45b0-888e-af2c806a81eb'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.978864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:46.984393 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] The token cache is being invalidate because project 58d46748e34f4a8485771b77393f0105 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:06:46.984682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.989517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-467593ce-4bb2-45b0-888e-af2c806a81eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:46.989517 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1439/2877] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:06:46 2022] DELETE /identity/v3/projects/58d46748e34f4a8485771b77393f0105 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:46.991903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f47959-58c2-4de3-b515-2102ac8e6146 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:46.992338 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f47959-58c2-4de3-b515-2102ac8e6146 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:46.992484 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f47959-58c2-4de3-b515-2102ac8e6146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.011915 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-f1f47959-58c2-4de3-b515-2102ac8e6146 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:47.013103 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f1f47959-58c2-4de3-b515-2102ac8e6146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:47.021745 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:47.071273 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1439/2878] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:47.079087 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e3e8-eb0f-4710-8a1d-61d681bf1c24 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.079401 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e3e8-eb0f-4710-8a1d-61d681bf1c24 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.079746 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5274e3e8-eb0f-4710-8a1d-61d681bf1c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.099377 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-5274e3e8-eb0f-4710-8a1d-61d681bf1c24 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:47.101487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-5274e3e8-eb0f-4710-8a1d-61d681bf1c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:47.110126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1440/2879] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:47.114352 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f47959-58c2-4de3-b515-2102ac8e6146 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.124007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f47959-58c2-4de3-b515-2102ac8e6146 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.128612 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.129225 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.129507 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.129808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.130502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:06:47.130849 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.132591 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:47.144847 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1440/2880] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 19:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:06:47.149063 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e3e8-eb0f-4710-8a1d-61d681bf1c24 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.158650 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5274e3e8-eb0f-4710-8a1d-61d681bf1c24 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.163519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.164128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.164602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.164871 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.165516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.167431 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:47.278832 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1441/2881] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:06:47 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:47.283366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.293592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea36f346-d599-40ba-adc6-dc7e3a9413d1 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.350099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.350720 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.351001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.351278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.351941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.353886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:47.452895 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1441/2882] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:06:47 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:47.456988 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.468501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd0889e-9f57-4427-a5cc-991005994b27 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.473243 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.473886 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.474172 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.474447 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.475146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.476723 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:47.486948 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1442/2883] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:47.490744 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.500503 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947fbdc1-531c-4ebb-98c6-b5a908c23ec4 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.505123 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698c7af-7574-431e-84ea-d0ef046beccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.505718 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698c7af-7574-431e-84ea-d0ef046beccc admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.506037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698c7af-7574-431e-84ea-d0ef046beccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.506314 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698c7af-7574-431e-84ea-d0ef046beccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.507001 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698c7af-7574-431e-84ea-d0ef046beccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.508589 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698c7af-7574-431e-84ea-d0ef046beccc admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:47.519801 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1442/2884] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:47.523715 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.534215 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88945961-ef55-4c5b-b776-a0b506036a4f admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.538764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.539515 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.539800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.540075 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] PATH_INFO: `/v3/projects/d778f0129a1c4d00b24753dcc8164ea9/users/d9e90f4c0d984a01819601b65c926ffe/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.554271 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d778f0129a1c4d00b24753dcc8164ea9, user_id=d9e90f4c0d984a01819601b65c926ffe, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.556933 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:47.623586 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1443/2885] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:47 2022] PUT /identity/v3/projects/d778f0129a1c4d00b24753dcc8164ea9/users/d9e90f4c0d984a01819601b65c926ffe/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:47.635546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8be82-6494-4bd2-b545-f31f82693b63 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.635856 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8be82-6494-4bd2-b545-f31f82693b63 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.636134 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a8be82-6494-4bd2-b545-f31f82693b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.664163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-a3a8be82-6494-4bd2-b545-f31f82693b63 None None] MFA Rules not processed for user `d9e90f4c0d984a01819601b65c926ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:47.665402 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-a3a8be82-6494-4bd2-b545-f31f82693b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:47.727663 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1443/2886] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:47 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:47.738660 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.740433 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:47.797839 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0454f-3816-4df5-a839-d718d63d35e6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.801372 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6094344-7034-4c6f-b246-981eabfb64b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.802014 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6094344-7034-4c6f-b246-981eabfb64b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.802296 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6094344-7034-4c6f-b246-981eabfb64b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.802569 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6094344-7034-4c6f-b246-981eabfb64b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.810671 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6094344-7034-4c6f-b246-981eabfb64b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.812738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6094344-7034-4c6f-b246-981eabfb64b6 service cinder] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:47.821448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1444/2887] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:47 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:06:47.842945 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8be82-6494-4bd2-b545-f31f82693b63 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:47.852592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:47.904115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a8be82-6494-4bd2-b545-f31f82693b63 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:47.908659 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:47.909288 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:47.909567 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:47.909868 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] PATH_INFO: `/v3/users/d9e90f4c0d984a01819601b65c926ffe` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:47.911007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9e90f4c0d984a01819601b65c926ffe)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:47.912912 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:48.117387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9e90f4c0d984a01819601b65c926ffe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:48.180275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9e90f4c0d984a01819601b65c926ffe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:48.188052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9e90f4c0d984a01819601b65c926ffe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:48.200212 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9e90f4c0d984a01819601b65c926ffe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:48.200865 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9e90f4c0d984a01819601b65c926ffe'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:48.206786 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1444/2888] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:06:47 2022] DELETE /identity/v3/users/d9e90f4c0d984a01819601b65c926ffe => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:48.211405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:48.211709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:48.211949 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:48.230348 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:48.231540 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:48.288997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1445/2889] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:06:48.299290 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:48.300808 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:48.356936 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6683fbe5-5642-4008-92b0-bed01515df3a admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:48.361012 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6fe99-ea05-46b7-bb4c-23b306252c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:48.361621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fe99-ea05-46b7-bb4c-23b306252c41 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:48.361933 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fe99-ea05-46b7-bb4c-23b306252c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:48.362204 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6fe99-ea05-46b7-bb4c-23b306252c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:48.371219 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6fe99-ea05-46b7-bb4c-23b306252c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:48.372585 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6fe99-ea05-46b7-bb4c-23b306252c41 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:48.384148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1445/2890] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:06:48.794091 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:48.795625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:48.809342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8407b-6e3d-4e6a-9d70-bcb6c9761098 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:48.814758 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:48.815406 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:48.815692 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:48.815969 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] PATH_INFO: `/v3/projects/d778f0129a1c4d00b24753dcc8164ea9` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:48.817711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d778f0129a1c4d00b24753dcc8164ea9)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:48.819952 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:48.906761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:48.918573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd778f0129a1c4d00b24753dcc8164ea9', 'request_id': 'req-1b74fe37-5267-433b-868c-6f6072031102'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:48.924628 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd778f0129a1c4d00b24753dcc8164ea9', 'request_id': 'req-1b74fe37-5267-433b-868c-6f6072031102'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:48.930740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd778f0129a1c4d00b24753dcc8164ea9', 'request_id': 'req-1b74fe37-5267-433b-868c-6f6072031102'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:49.023505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] The token cache is being invalidate because project d778f0129a1c4d00b24753dcc8164ea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:06:49.023794 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:49.024456 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-1b74fe37-5267-433b-868c-6f6072031102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:06:49.026350 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1446/2891] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:06:48 2022] DELETE /identity/v3/projects/d778f0129a1c4d00b24753dcc8164ea9 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:49.031158 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f27f-9ef6-4dab-892a-3a363581057b None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.031655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f27f-9ef6-4dab-892a-3a363581057b None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.031990 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148f27f-9ef6-4dab-892a-3a363581057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.052333 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-1148f27f-9ef6-4dab-892a-3a363581057b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:49.053525 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1148f27f-9ef6-4dab-892a-3a363581057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:49.080542 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:49.113810 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1446/2892] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:49.121284 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba953c70-4da5-487b-85d3-a8be578ebd38 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.121573 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba953c70-4da5-487b-85d3-a8be578ebd38 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.121885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba953c70-4da5-487b-85d3-a8be578ebd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.143052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-ba953c70-4da5-487b-85d3-a8be578ebd38 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:49.144235 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-ba953c70-4da5-487b-85d3-a8be578ebd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:49.152190 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1447/2893] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:49.156380 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f27f-9ef6-4dab-892a-3a363581057b None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:49.165919 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148f27f-9ef6-4dab-892a-3a363581057b None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:49.170430 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:49.171077 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.171356 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.171628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.172313 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:06:49.172615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:49.174239 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:49.186076 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1447/2894] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 19:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:06:49.190694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba953c70-4da5-487b-85d3-a8be578ebd38 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:49.199658 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba953c70-4da5-487b-85d3-a8be578ebd38 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:49.204897 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:49.205485 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.205785 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.206061 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.206706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:49.208565 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:49.296047 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1448/2895] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:06:49 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:49.300143 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:49.309970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c27021d-3081-4265-b296-d7702d466244 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:49.367011 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:49.367621 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.367899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.368171 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.368816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:49.370766 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:49.478007 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1448/2896] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:06:49 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:06:49.482303 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:49.493088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1239e8f8-703c-4123-85f8-e8cba4a43023 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:49.497892 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:49.498501 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.498782 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.499728 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.500351 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:49.501975 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:49.511851 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1449/2897] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:49.516002 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:49.526003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23d43ae-4062-4fc2-a1b3-af101f799b39 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:49.530626 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d4b38c-7ea3-43ac-8d99-424b21fa381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:49.531226 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b38c-7ea3-43ac-8d99-424b21fa381d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.531509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b38c-7ea3-43ac-8d99-424b21fa381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.531789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d4b38c-7ea3-43ac-8d99-424b21fa381d admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.532476 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b38c-7ea3-43ac-8d99-424b21fa381d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:49.534148 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d4b38c-7ea3-43ac-8d99-424b21fa381d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:49.544546 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1449/2898] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:06:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:06:49.549133 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:49.559131 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad536865-349f-4097-abb3-43730f9fd0ad admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:49.564434 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:49.565085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.565366 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.565639 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] PATH_INFO: `/v3/projects/469957abe1d347a7964feb5bd5482f67/users/51d876edeeb1460e884ebf09f35d678d/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.579939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469957abe1d347a7964feb5bd5482f67, user_id=51d876edeeb1460e884ebf09f35d678d, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:49.582619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:49.654895 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1450/2899] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:06:49 2022] PUT /identity/v3/projects/469957abe1d347a7964feb5bd5482f67/users/51d876edeeb1460e884ebf09f35d678d/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:06:49.665107 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd781892-14a0-4b96-9f90-c1f94dadc9b7 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.665397 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd781892-14a0-4b96-9f90-c1f94dadc9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.665679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd781892-14a0-4b96-9f90-c1f94dadc9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.694324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-bd781892-14a0-4b96-9f90-c1f94dadc9b7 None None] MFA Rules not processed for user `51d876edeeb1460e884ebf09f35d678d`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:06:49.695537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-bd781892-14a0-4b96-9f90-c1f94dadc9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:49.758120 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1450/2900] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:06:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:06:49.769409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:06:49.771093 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:06:49.847864 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aafdc18-517c-4dd8-a46a-b281b7502dd6 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:06:49.851550 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0977d01-f752-468e-a1fc-f8c2beb5cb99 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:06:49.852155 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977d01-f752-468e-a1fc-f8c2beb5cb99 service glance] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:06:49.852429 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977d01-f752-468e-a1fc-f8c2beb5cb99 service glance] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:06:49.852697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0977d01-f752-468e-a1fc-f8c2beb5cb99 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:06:49.861324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0977d01-f752-468e-a1fc-f8c2beb5cb99 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:06:49.862755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0977d01-f752-468e-a1fc-f8c2beb5cb99 service glance] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:06:49.871291 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1451/2901] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:06:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:06:59.755152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=85,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:06:59.867498 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=74,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:09.086387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd781892-14a0-4b96-9f90-c1f94dadc9b7 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:09.148653 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd781892-14a0-4b96-9f90-c1f94dadc9b7 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:09.153154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:09.153814 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:09.154099 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:09.154376 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] PATH_INFO: `/v3/users/51d876edeeb1460e884ebf09f35d678d` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:09.155537 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51d876edeeb1460e884ebf09f35d678d)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:09.157436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:09.330703 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51d876edeeb1460e884ebf09f35d678d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:09.407955 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51d876edeeb1460e884ebf09f35d678d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:09.415141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51d876edeeb1460e884ebf09f35d678d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:09.426989 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51d876edeeb1460e884ebf09f35d678d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:09.427630 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51d876edeeb1460e884ebf09f35d678d'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:09.433453 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1451/2902] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:07:09 2022] DELETE /identity/v3/users/51d876edeeb1460e884ebf09f35d678d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:07:09.438128 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:09.438615 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:09.438704 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:09.458866 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:09.460079 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:09.518003 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1452/2903] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:07:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 27 19:07:09.528509 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:09.532303 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:09.591098 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd5ebb-ee32-4bea-b133-549c03ad2617 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:09.594710 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5bfbb-de32-4bce-a7c5-26d4d9507fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:09.595324 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5bfbb-de32-4bce-a7c5-26d4d9507fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:09.595603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5bfbb-de32-4bce-a7c5-26d4d9507fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:09.595875 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5bfbb-de32-4bce-a7c5-26d4d9507fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:09.604754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5bfbb-de32-4bce-a7c5-26d4d9507fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:09.606211 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5bfbb-de32-4bce-a7c5-26d4d9507fc4 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:09.615617 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1452/2904] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:09.992744 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:09.996736 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:10.007428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363e717b-1817-4197-9ff3-01c09090d12d None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:10.013255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:10.013959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.014240 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.014513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] PATH_INFO: `/v3/projects/469957abe1d347a7964feb5bd5482f67` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.016012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469957abe1d347a7964feb5bd5482f67)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:10.017913 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:10.124505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469957abe1d347a7964feb5bd5482f67', 'request_id': 'req-8609a0da-eff2-4e11-b852-7204f0cf24a6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:10.130405 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469957abe1d347a7964feb5bd5482f67', 'request_id': 'req-8609a0da-eff2-4e11-b852-7204f0cf24a6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:10.136711 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469957abe1d347a7964feb5bd5482f67', 'request_id': 'req-8609a0da-eff2-4e11-b852-7204f0cf24a6'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:10.228058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] The token cache is being invalidate because project 469957abe1d347a7964feb5bd5482f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:07:10.228345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:10.228968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-8609a0da-eff2-4e11-b852-7204f0cf24a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:07:10.230522 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1453/2905] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:07:09 2022] DELETE /identity/v3/projects/469957abe1d347a7964feb5bd5482f67 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:07:10.236418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c81d7-164b-4e75-9ab2-6aec03aa4f9f None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.236893 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c81d7-164b-4e75-9ab2-6aec03aa4f9f None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.236987 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c81d7-164b-4e75-9ab2-6aec03aa4f9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.257178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d56c81d7-164b-4e75-9ab2-6aec03aa4f9f None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:10.258405 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d56c81d7-164b-4e75-9ab2-6aec03aa4f9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:10.275412 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:10.318966 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1453/2906] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:10.327706 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3330-f81e-4495-91b7-a59cb8bdd54b None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.328030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3330-f81e-4495-91b7-a59cb8bdd54b None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.328267 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c3330-f81e-4495-91b7-a59cb8bdd54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.347587 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-9d0c3330-f81e-4495-91b7-a59cb8bdd54b None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:10.349214 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9d0c3330-f81e-4495-91b7-a59cb8bdd54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:10.357058 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1454/2907] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:10.361264 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c81d7-164b-4e75-9ab2-6aec03aa4f9f None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:10.371518 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c81d7-164b-4e75-9ab2-6aec03aa4f9f None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:10.376183 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:10.376787 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.377069 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.377347 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] PATH_INFO: `/v3/domains` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.378131 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80553) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 27 19:07:10.378439 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:10.380037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:10.392113 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1454/2908] 10.222.0.67 () {58 vars in 1153 bytes} [Wed Jul 27 19:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 27 19:07:10.400345 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c3330-f81e-4495-91b7-a59cb8bdd54b None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:10.409572 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c3330-f81e-4495-91b7-a59cb8bdd54b None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:10.414902 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:10.415505 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.415791 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.416062 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.416718 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:10.418648 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:10.497633 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1455/2909] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:07:10 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:07:10.501824 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:10.511754 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfccafe-8369-4d93-8f35-8655dc10ea3e admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:10.567820 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:10.568428 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.568707 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.568978 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.569634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:10.571592 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:10.674108 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1455/2910] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:07:10 2022] POST /identity/v3/users => generated 292 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:07:10.678659 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:10.688998 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747af138-a492-43a6-9045-7a1f09883eda admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:10.693725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:10.694360 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.694641 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.694947 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.695603 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:10.697201 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:10.707783 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1456/2911] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:07:10.711604 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:10.721655 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c7c8a-ab9d-480e-9ce9-944b679555d4 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:10.727223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9042b9c5-f2ad-40a8-9852-142309fb289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:10.727833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b9c5-f2ad-40a8-9852-142309fb289d admin admin] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.728115 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b9c5-f2ad-40a8-9852-142309fb289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.728390 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9042b9c5-f2ad-40a8-9852-142309fb289d admin admin] PATH_INFO: `/v3/roles` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.729075 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042b9c5-f2ad-40a8-9852-142309fb289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:10.730702 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9042b9c5-f2ad-40a8-9852-142309fb289d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:10.741325 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1456/2912] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:07:10.745487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:10.755827 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16901e-54dd-432d-8fb9-f800eaac181b admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:10.760443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:10.761085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.761368 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.761645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] PATH_INFO: `/v3/projects/c4ca045e4863458e84f2cc718ac09658/users/f0d8a25ce55d43deadf09b7fc403c178/roles/7eedc9e13d08457aadc35a07c8edc18c` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.776681 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4ca045e4863458e84f2cc718ac09658, user_id=f0d8a25ce55d43deadf09b7fc403c178, role_id=7eedc9e13d08457aadc35a07c8edc18c)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:10.779354 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:10.850997 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1457/2913] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:07:10 2022] PUT /identity/v3/projects/c4ca045e4863458e84f2cc718ac09658/users/f0d8a25ce55d43deadf09b7fc403c178/roles/7eedc9e13d08457aadc35a07c8edc18c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:07:10.858807 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cee601-a08e-4d2b-b368-0f6daca973d0 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:10.859117 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cee601-a08e-4d2b-b368-0f6daca973d0 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:10.859387 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cee601-a08e-4d2b-b368-0f6daca973d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:10.878064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-d5cee601-a08e-4d2b-b368-0f6daca973d0 None None] MFA Rules not processed for user `3a547ecd2bf446a2aa047f5f9c68c5a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:10.879739 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-d5cee601-a08e-4d2b-b368-0f6daca973d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:10.936583 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1457/2914] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:10.946544 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:10.948241 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:10.970602 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:11.005597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abead985-3cdd-458b-b99e-28907eab26b0 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:11.009426 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:11.010096 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:11.010432 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:11.010714 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:11.020644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:11.022105 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:11.032489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1458/2915] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:16.276145 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d105098-cc0d-43ff-a8fd-828865969ddb None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:16.277201 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d105098-cc0d-43ff-a8fd-828865969ddb None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:16.277892 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d105098-cc0d-43ff-a8fd-828865969ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:16.309330 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-6d105098-cc0d-43ff-a8fd-828865969ddb None None] MFA Rules not processed for user `f0d8a25ce55d43deadf09b7fc403c178`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:16.310588 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-6d105098-cc0d-43ff-a8fd-828865969ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:16.331026 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:16.380140 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1458/2916] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:07:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:16.384815 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:16.395854 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88269-ad8e-4da6-82cd-213e1e9a9409 service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:16.400542 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:16.401189 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:16.401467 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:16.401788 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] PATH_INFO: `/v3/projects` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:16.402489 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:16.404513 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:16.499454 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1459/2917] 10.222.0.67 () {60 vars in 1153 bytes} [Wed Jul 27 19:07:16 2022] POST /identity/v3/projects => generated 385 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:07:16.506360 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d105098-cc0d-43ff-a8fd-828865969ddb None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:16.531731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d105098-cc0d-43ff-a8fd-828865969ddb None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:16.596052 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:16.596705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:16.596983 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:16.597254 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] PATH_INFO: `/v3/users` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:16.597947 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:16.599914 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:16.700441 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1459/2918] 10.222.0.67 () {60 vars in 1144 bytes} [Wed Jul 27 19:07:16 2022] POST /identity/v3/users => generated 299 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 27 19:07:16.704622 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:16.715126 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce0fd8-666c-4d78-b4a9-3e67bc82d646 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:16.719862 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:16.720423 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:16.720707 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:16.720983 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:16.721699 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:16.723568 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:16.738236 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1460/2919] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:07:16.739938 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:16.750564 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf213f0-55b5-4016-9fb3-e22121e44c00 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:16.756005 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:16.756665 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:16.756943 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:16.757223 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] PATH_INFO: `/v3/projects/0fe5748aa1264727ab49d54f7f445d42/users/098a847e1a81427a9c5dfbe7efe92b94/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:16.772903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe5748aa1264727ab49d54f7f445d42, user_id=098a847e1a81427a9c5dfbe7efe92b94, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:16.775603 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:16.849519 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1460/2920] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:07:16 2022] PUT /identity/v3/projects/0fe5748aa1264727ab49d54f7f445d42/users/098a847e1a81427a9c5dfbe7efe92b94/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:07:16.853571 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:16.864625 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b1d3da-4290-4afa-82ec-fb7f9908bb8c admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:16.920519 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822c89ba-de85-4233-a156-8d34f30c804a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:16.921273 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c89ba-de85-4233-a156-8d34f30c804a admin admin] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:16.921428 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c89ba-de85-4233-a156-8d34f30c804a admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:16.921698 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822c89ba-de85-4233-a156-8d34f30c804a admin admin] PATH_INFO: `/v3/roles` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:16.922443 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c89ba-de85-4233-a156-8d34f30c804a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:16.924272 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822c89ba-de85-4233-a156-8d34f30c804a admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:16.935481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1461/2921] 10.222.0.67 () {58 vars in 1122 bytes} [Wed Jul 27 19:07:16 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 27 19:07:16.939685 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:16.950312 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a8d6b-e286-450a-8b5f-4e8861ad033d admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:16.955192 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:16.955855 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:16.956130 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:16.956400 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] PATH_INFO: `/v3/projects/0fe5748aa1264727ab49d54f7f445d42/users/098a847e1a81427a9c5dfbe7efe92b94/roles/3e04c3350d96492f859c4b4fce594b16` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:16.958361 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fe5748aa1264727ab49d54f7f445d42, user_id=098a847e1a81427a9c5dfbe7efe92b94, role_id=3e04c3350d96492f859c4b4fce594b16)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:16.960991 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:16.971842 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1461/2922] 10.222.0.67 () {60 vars in 1483 bytes} [Wed Jul 27 19:07:16 2022] PUT /identity/v3/projects/0fe5748aa1264727ab49d54f7f445d42/users/098a847e1a81427a9c5dfbe7efe92b94/roles/3e04c3350d96492f859c4b4fce594b16 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:07:22.625755 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ed78-e40a-4673-8c3a-60ef0f3e8fc5 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:22.626288 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ed78-e40a-4673-8c3a-60ef0f3e8fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:22.626363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3829ed78-e40a-4673-8c3a-60ef0f3e8fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:22.678438 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-3829ed78-e40a-4673-8c3a-60ef0f3e8fc5 None None] MFA Rules not processed for user `098a847e1a81427a9c5dfbe7efe92b94`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:22.679694 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-3829ed78-e40a-4673-8c3a-60ef0f3e8fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:22.758538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1462/2923] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:07:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:22.771544 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:22.773972 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:22.842374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe54bc-675a-4b33-961e-658c3c7a4b13 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:22.846907 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:22.847539 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:22.847816 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:22.848238 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:22.880269 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:22.923877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:22.925351 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:22.947337 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1462/2924] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:23.209370 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2757b-08c1-48bc-8c7a-210caa64a0a6 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:23.209661 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2757b-08c1-48bc-8c7a-210caa64a0a6 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:23.209962 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b2757b-08c1-48bc-8c7a-210caa64a0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:23.226613 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:23.273440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-f3b2757b-08c1-48bc-8c7a-210caa64a0a6 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:23.274725 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-f3b2757b-08c1-48bc-8c7a-210caa64a0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:23.338949 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1463/2925] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 19:07:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:23.519615 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:23.521023 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:23.618399 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657bcb33-e3e6-44e1-9ef3-72a2b93b29f7 service glance] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:23.623366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:23.623985 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:23.624263 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:23.624531 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:23.632934 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:23.634563 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:23.642899 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1463/2926] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 19:07:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:07:33.393503 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:33.394123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:33.394123 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:33.413151 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] MFA Rules not processed for user `f0d8a25ce55d43deadf09b7fc403c178`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:33.414380 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:33.421250 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1464/2927] 10.222.0.67 () {58 vars in 958 bytes} [Wed Jul 27 19:07:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:33.459873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:33.469206 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acce0e89-b9a5-4945-ab5a-15a127a60cf5 service swift] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:33.473062 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9d4eba8e853c41bcbd92d6cab54efd0e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:33.473705 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:33.474009 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:33.474773 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:33.476586 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:33.547789 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:33.549222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:33.561091 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1464/2928] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:33.776374 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:33.777810 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:33.834187 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063cdcc7-45fa-4a4c-ac75-afab1c2f8cc1 None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:33.837752 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e725eb-d78e-4801-98f8-9ef4b058ab5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:33.838409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e725eb-d78e-4801-98f8-9ef4b058ab5c service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:33.838688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e725eb-d78e-4801-98f8-9ef4b058ab5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:33.838959 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e725eb-d78e-4801-98f8-9ef4b058ab5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:33.840684 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-16e725eb-d78e-4801-98f8-9ef4b058ab5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:33.850560 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e725eb-d78e-4801-98f8-9ef4b058ab5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:33.851974 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e725eb-d78e-4801-98f8-9ef4b058ab5c service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:33.859996 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1465/2929] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:34.288794 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:34.290276 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:34.312756 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:34.360154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e3be7-0ca0-4fd3-ad09-811e7a41db24 service glance] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:34.365064 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:34.365671 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:34.365975 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:34.366245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:34.367963 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:34.378964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:34.381018 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:34.391149 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1465/2930] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:37.317268 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46b08-ff7a-4cc5-98f4-a61aeffbed6f None None] REQUEST_METHOD: `POST` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:37.317739 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46b08-ff7a-4cc5-98f4-a61aeffbed6f None None] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:37.317885 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c46b08-ff7a-4cc5-98f4-a61aeffbed6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:37.338705 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.auth.core [None req-43c46b08-ff7a-4cc5-98f4-a61aeffbed6f None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80552) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:07:37.339940 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-43c46b08-ff7a-4cc5-98f4-a61aeffbed6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:37.347120 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1466/2931] 10.222.0.67 () {58 vars in 1009 bytes} [Wed Jul 27 19:07:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:07:37.360244 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:37.372220 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f937383-3cab-4c28-a77c-0a0455860657 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:37.377224 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:37.377873 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:37.378159 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:37.378438 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:37.387464 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:37.389054 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:37.398775 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1466/2932] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 19:07:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 27 19:07:42.182484 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c46b08-ff7a-4cc5-98f4-a61aeffbed6f None None] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:42.192153 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c46b08-ff7a-4cc5-98f4-a61aeffbed6f None None] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:42.195761 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:42.196365 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:42.196645 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:42.196922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:42.198665 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:42.208196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:42.209626 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:42.218289 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1467/2933] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:47.394795 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=29 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:51.556628 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:51.558213 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:51.614019 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f03b7db-a352-4cf6-9fc7-d25e9fc05fc9 service swift] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:51.617584 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d75852e9db24464bd69c0c19b75ab39', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:51.618222 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:51.618506 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:51.618778 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:51.620508 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:51.701246 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:51.702634 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:51.721078 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1467/2934] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:51 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:07:52.214688 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=77 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:07:53.465413 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:07:53.466956 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:53.483066 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc79fa2-edc4-457d-8f6b-8b3c1617c58d service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:07:53.488539 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:07:53.489262 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:07:53.489552 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:07:53.489860 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:07:53.491579 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:07:53.503585 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:07:53.505188 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:07:53.516324 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1468/2935] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:07:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 27 19:08:01.718501 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=61 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:03.511753 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=6 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:04.985366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:04.997420 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f896a9f-b9b4-4977-b3d3-064c60807965 service cinder] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:05.002450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:05.003081 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:05.003365 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:05.003644 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:05.005450 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:05.017678 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:05.019547 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:05.029606 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1468/2936] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:08:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:08:08.653516 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:08.663140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005a8506-c5fa-4edc-96fa-cde8b024f039 service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:08.667260 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:08.667863 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:08.668140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:08.668409 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:08.677173 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:08.678619 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:08.688320 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1469/2937] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:08:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:08:10.513249 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:10.527366 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db8a799-289a-4b62-a190-ee1b66962dc8 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:10.533471 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4732f-343d-43fd-b79c-adefa4cc9777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:10.536679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4732f-343d-43fd-b79c-adefa4cc9777 service nova] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:10.536679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4732f-343d-43fd-b79c-adefa4cc9777 service nova] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:10.536679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4732f-343d-43fd-b79c-adefa4cc9777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:10.537146 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-98d4732f-343d-43fd-b79c-adefa4cc9777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:10.554833 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4732f-343d-43fd-b79c-adefa4cc9777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:10.556445 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4732f-343d-43fd-b79c-adefa4cc9777 service nova] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:10.571229 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1469/2938] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:08:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:08:13.562183 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:08:13.576951 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c108a0-3bd6-4005-a574-f123c6889d4c service neutron] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:08:13.586448 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4e107a27b86243dcbb160a3960682b2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:08:13.587403 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:08:13.588052 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:08:13.588482 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:08:13.590597 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:08:13.609487 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:08:13.611417 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:08:13.636385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1470/2939] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:08:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:08:20.566318 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=12 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:08:23.629893 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=12 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:25.277649 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a0017-8661-4c74-8a47-c3b1f6581226 None None] REQUEST_METHOD: `POST` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.278174 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a0017-8661-4c74-8a47-c3b1f6581226 None None] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.278283 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a0017-8661-4c74-8a47-c3b1f6581226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.297152 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.auth.core [None req-956a0017-8661-4c74-8a47-c3b1f6581226 None None] MFA Rules not processed for user `8538be4294e842e58aca6881db9002e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80553) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 27 19:09:25.298386 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-956a0017-8661-4c74-8a47-c3b1f6581226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:25.305605 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1470/2940] 10.222.0.67 () {58 vars in 967 bytes} [Wed Jul 27 19:09:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 27 19:09:25.351696 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:25.362968 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20edc63-f5df-43c0-8d42-36005673e69d service nova] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:25.368146 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e70a3ed5aa5441fb9e8d4ed8f071bcc0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:25.368697 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:25.368977 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:25.369247 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:25.377596 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:25.379248 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:25.387883 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1471/2941] 10.222.0.67 () {60 vars in 1384 bytes} [Wed Jul 27 19:09:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 27 19:09:33.485275 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a0017-8661-4c74-8a47-c3b1f6581226 None None] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:33.548799 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a0017-8661-4c74-8a47-c3b1f6581226 None None] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:33.553210 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:33.553999 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:33.554281 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:33.554555 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] PATH_INFO: `/v3/users/f0d8a25ce55d43deadf09b7fc403c178` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:33.556470 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0d8a25ce55d43deadf09b7fc403c178)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:33.558419 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:33.732234 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0d8a25ce55d43deadf09b7fc403c178'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:33.786341 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0d8a25ce55d43deadf09b7fc403c178'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:33.794043 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0d8a25ce55d43deadf09b7fc403c178'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:33.806112 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0d8a25ce55d43deadf09b7fc403c178'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:33.806679 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0d8a25ce55d43deadf09b7fc403c178'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:33.812490 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1471/2942] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:09:33 2022] DELETE /identity/v3/users/f0d8a25ce55d43deadf09b7fc403c178 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 27 19:09:34.045607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:34.058674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5693a4e-fe6c-41d9-80bd-b1b6d12266e4 service swift] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:34.116750 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:34.117395 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:34.117680 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:34.118013 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] PATH_INFO: `/v3/projects/c4ca045e4863458e84f2cc718ac09658` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:34.119799 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4ca045e4863458e84f2cc718ac09658)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:34.121740 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:34.244691 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4ca045e4863458e84f2cc718ac09658', 'request_id': 'req-9c9bf386-18c0-405f-8ce4-6832786dcc42'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.250166 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4ca045e4863458e84f2cc718ac09658', 'request_id': 'req-9c9bf386-18c0-405f-8ce4-6832786dcc42'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.256211 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4ca045e4863458e84f2cc718ac09658', 'request_id': 'req-9c9bf386-18c0-405f-8ce4-6832786dcc42'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.316682 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] The token cache is being invalidate because project c4ca045e4863458e84f2cc718ac09658 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:09:34.316904 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.317538 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.319085 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1472/2943] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:09:34 2022] DELETE /identity/v3/projects/c4ca045e4863458e84f2cc718ac09658 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:34.323178 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:34.324691 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:34.338278 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba30d6d9-29f5-4719-a6ee-541c2827c337 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:34.393448 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:34.394181 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:34.394459 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:34.394731 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] PATH_INFO: `/v3/users/098a847e1a81427a9c5dfbe7efe92b94` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:34.395998 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098a847e1a81427a9c5dfbe7efe92b94)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:34.397940 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:34.411160 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:34.559730 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098a847e1a81427a9c5dfbe7efe92b94'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.683624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098a847e1a81427a9c5dfbe7efe92b94'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.691141 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098a847e1a81427a9c5dfbe7efe92b94'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.703058 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098a847e1a81427a9c5dfbe7efe92b94'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.703706 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098a847e1a81427a9c5dfbe7efe92b94'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:34.709898 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1472/2944] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:09:34 2022] DELETE /identity/v3/users/098a847e1a81427a9c5dfbe7efe92b94 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:35.005144 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:09:35.006674 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:09:35.020140 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bf386-18c0-405f-8ce4-6832786dcc42 admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:09:35.081308 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:09:35.081942 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:09:35.082200 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:09:35.082481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] PATH_INFO: `/v3/projects/0fe5748aa1264727ab49d54f7f445d42` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:09:35.083679 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fe5748aa1264727ab49d54f7f445d42)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:09:35.085578 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:09:35.107362 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:35.210924 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fe5748aa1264727ab49d54f7f445d42', 'request_id': 'req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:35.216857 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fe5748aa1264727ab49d54f7f445d42', 'request_id': 'req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:35.225385 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fe5748aa1264727ab49d54f7f445d42', 'request_id': 'req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:35.312012 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] The token cache is being invalidate because project 0fe5748aa1264727ab49d54f7f445d42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80552) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:09:35.312293 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:35.312912 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:09:35.314473 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1473/2945] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:09:35 2022] DELETE /identity/v3/projects/0fe5748aa1264727ab49d54f7f445d42 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:09:44.706154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=21,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:09:45.308800 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:10:52.622970 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:52.624474 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:52.684418 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f189338-82ab-4d53-869f-9c07f1794416 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:52.731265 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '052da4ed2e054c70ba8b0bf9b6c5656a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:52.731877 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:52.732154 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:52.732426 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:52.734196 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:52.795245 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:52.796674 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:52.806375 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1473/2946] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:56.271543 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:56.272934 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:56.343349 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a0188-19ba-45b0-a6fa-8e7e5523235e admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:56.348992 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:56.349607 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:56.349921 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:56.350196 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:56.352030 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:56.364321 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:56.365939 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:56.375708 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1474/2947] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:10:59.902443 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:10:59.914601 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cd17f9-7a21-4207-81ab-7acfd6268c94 service neutron] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:10:59.919569 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:10:59.920207 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] REQUEST_METHOD: `GET` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:10:59.920488 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:10:59.920762 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:10:59.922574 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:10:59.935331 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:10:59.936950 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:10:59.947629 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1474/2948] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:10:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:11:00.009399 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:00.010967 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:11:00.025440 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d584e0b-7bb6-40b0-8728-60da1bda6ab4 service placement] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:00.030322 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:00.030923 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:00.031255 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:00.031527 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] PATH_INFO: `/v3/users/0104b0fa57ac4ea280ffd3fc540e6358` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:00.032677 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] RBAC: Authorizing `identity:delete_user(user_id=0104b0fa57ac4ea280ffd3fc540e6358)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:00.034644 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:00.198191 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0104b0fa57ac4ea280ffd3fc540e6358'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.198764 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0104b0fa57ac4ea280ffd3fc540e6358'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.211383 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0104b0fa57ac4ea280ffd3fc540e6358'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.212029 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0104b0fa57ac4ea280ffd3fc540e6358'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.274731 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0104b0fa57ac4ea280ffd3fc540e6358'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.288795 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1475/2949] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:11:00 2022] DELETE /identity/v3/users/0104b0fa57ac4ea280ffd3fc540e6358 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:11:00.568468 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:00.584295 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b3a24-9ec2-4d21-a0f5-d434570a8c54 service placement] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:00.641139 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=100 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:00.651016 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:00.651903 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:00.652449 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:00.652734 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] PATH_INFO: `/v3/projects/09e1f32b9502471fa13e71685c01a16e` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:00.654003 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09e1f32b9502471fa13e71685c01a16e)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:00.656384 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:00.752121 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09e1f32b9502471fa13e71685c01a16e', 'request_id': 'req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.841785 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09e1f32b9502471fa13e71685c01a16e', 'request_id': 'req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.847954 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09e1f32b9502471fa13e71685c01a16e', 'request_id': 'req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.859163 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] The token cache is being invalidate because project 09e1f32b9502471fa13e71685c01a16e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:11:00.859477 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.860105 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:00.861624 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1475/2950] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:11:00 2022] DELETE /identity/v3/projects/09e1f32b9502471fa13e71685c01a16e => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:11:00.865709 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:00.867161 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:11:00.880945 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc8379-ef16-4e26-812b-590e4ba809de admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:00.937256 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:00.937922 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:00.938202 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:00.938477 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] PATH_INFO: `/v3/users/2b323955c030440faeed55bfe618db8b` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:00.941081 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:00.952478 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b323955c030440faeed55bfe618db8b)` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:00.954450 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:01.237481 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b323955c030440faeed55bfe618db8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.238206 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b323955c030440faeed55bfe618db8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.251088 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b323955c030440faeed55bfe618db8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.251738 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b323955c030440faeed55bfe618db8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.349506 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.notifications [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b323955c030440faeed55bfe618db8b'} {{(pid=80552) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.362342 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1476/2951] 10.222.0.67 () {58 vars in 1224 bytes} [Wed Jul 27 19:11:00 2022] DELETE /identity/v3/users/2b323955c030440faeed55bfe618db8b => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:11:01.568941 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Authenticating user token {{(pid=80553) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:11:01.570436 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.fernet_utils [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80553) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:11:01.583890 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e665e13-bd3e-4ec0-8c6b-d3db21b68927 admin admin] Validating token access rules against request {{(pid=80553) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:11:01.640126 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a547ecd2bf446a2aa047f5f9c68c5a5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '92b4949330f5444faa0288f0a88fa18a', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80553) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:11:01.640690 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:11:01.640964 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:11:01.641232 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] PATH_INFO: `/v3/projects/34175abb7eb540bdb12484eb85f562dd` {{(pid=80553) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:11:01.651414 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34175abb7eb540bdb12484eb85f562dd)` {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:11:01.653554 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] RBAC: Authorization granted {{(pid=80553) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:11:01.802502 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34175abb7eb540bdb12484eb85f562dd', 'request_id': 'req-9028040a-eb7f-47f5-b527-865e3a7006b3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.887576 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34175abb7eb540bdb12484eb85f562dd', 'request_id': 'req-9028040a-eb7f-47f5-b527-865e3a7006b3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.899037 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34175abb7eb540bdb12484eb85f562dd', 'request_id': 'req-9028040a-eb7f-47f5-b527-865e3a7006b3'} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.905942 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] The token cache is being invalidate because project 34175abb7eb540bdb12484eb85f562dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80553) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 27 19:11:01.906235 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.906864 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG keystone.notifications [None req-9028040a-eb7f-47f5-b527-865e3a7006b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80553) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 27 19:11:01.908374 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: [pid: 80553|app: 0|req: 1476/2952] 10.222.0.67 () {58 vars in 1233 bytes} [Wed Jul 27 19:11:01 2022] DELETE /identity/v3/projects/34175abb7eb540bdb12484eb85f562dd => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 27 19:11:11.358721 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=30,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:11:11.902886 dv-cinder-799871-43-iscsi devstack@keystone.service[80553]: DEBUG dbcounter [-] [80553] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80553) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 27 19:13:07.982074 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Authenticating user token {{(pid=80552) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 27 19:13:07.983482 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:08.121981 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf6897a-ac99-4480-aa12-e22820d6171d admin admin] Validating token access rules against request {{(pid=80552) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 27 19:13:08.179410 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bb7ce-2b7a-4d6d-9fe2-45a1f4bd83ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8bd7c735f47f4810a8a6e3e52adbb756', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0cf0ac49dc804d21bbd0073993b309cc', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80552) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 27 19:13:08.180056 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb7ce-2b7a-4d6d-9fe2-45a1f4bd83ba service placement] REQUEST_METHOD: `GET` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 27 19:13:08.180336 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb7ce-2b7a-4d6d-9fe2-45a1f4bd83ba service placement] SCRIPT_NAME: `/identity` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 27 19:13:08.180609 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bb7ce-2b7a-4d6d-9fe2-45a1f4bd83ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80552) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 27 19:13:08.182363 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.fernet_utils [None req-630bb7ce-2b7a-4d6d-9fe2-45a1f4bd83ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80552) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 27 19:13:08.193257 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb7ce-2b7a-4d6d-9fe2-45a1f4bd83ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 27 19:13:08.194843 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630bb7ce-2b7a-4d6d-9fe2-45a1f4bd83ba service placement] RBAC: Authorization granted {{(pid=80552) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 27 19:13:08.205043 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: [pid: 80552|app: 0|req: 1477/2953] 10.222.0.67 () {60 vars in 1365 bytes} [Wed Jul 27 19:13:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 27 19:13:18.200536 dv-cinder-799871-43-iscsi devstack@keystone.service[80552]: DEBUG dbcounter [-] [80552] Writing DB stats keystone:SELECT=89 {{(pid=80552) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}